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The Center for Social Organization of Schools has two primary -. x 

objectives; t^o develop a scientific knowledge of how schools affect their 
students, and to use this knowledge \to develop better school practices and 
organization.' ; v * $ . ^ 

The (Tenter works through three research programs to'c§chieve dts 0 ■■ 
^bjectives. The School' eTrganization Pi-'ogram investigates how school and 
classroom organization affects student learning and other outcomes. Current 
.studies focus on parental involvement, microcomputers, use o# time in. schools 
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Work Program examines the relationship between school-ing and students' later- 
life occupational and educational success. Current projects include studies 
of the comp*e£encies required in the workplace., Jthe sources of "training and 
experience that lead to employment, college students' major field choices, 



ax\d employment 'of urban minority youth. The Delinquency and School— Env-iron^ l 
ments Program researches- the problem of crime, violence, vandalism, and < 
disorder in schools ^and^the role that schools play in delinquency. Ongoing ; 
.studies address the need to develop a strong thaoEy of delinquent behavior 
while examining school effects on delinquency and evaluating delinquency' 
prevention programs in and outside of schools, 

■The Center also supports a Fellowships in Education Research program 

that provides opportunities for talented, young researchers to conduct and 

■ ' * ■ ■. 

publish significant research and encourages the participation of women and 

minorities in research on education. 

This repfort,, prepared by the Delinquent and School Environments Program 

describes further inter.im results «of the program's national evaluation of 

the Office of Juvenile Justice and Delinquency Prevention's (OJJDP's) 

Alternative Education -program. First interim results were reported .in 

CoOS Report No. 325, April 1982. 
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The School Action Effectiveness 
Study . (SAES) is the national "evalua- 
tion of the Off ice- 'for Juvenile Jus- 
tice and Delinquency Prevention 6 
(OJJDP's) Alternative Education pro- 
gram. _ The stiidy is- rooted i$ the* 
perception ..that reducing 'the risk?" of 
youth 'cririte requires the ,co 1 labor a- 
tive ,'ef fo^t of practitioners,, 
researchers , and project sponsors, 
Together,' these groups^ can create' 
change and examine its -consequences 
'in settings where* answers aire, needed 
and problems are i;eal- r * •» 

The study is atyso' rooted in the 
notion that .theoi$ is an essential 
ingredient • of botti^^irqgram develop- , 
ment and valuation t *:esearcl) . Con- 
sequently j SAES aimsNiq* implement 
the. Program Development Evaluation 
(PIJE) method,, collaborating with 
pracftitioners ; ia specifying? theory- 7 
ba'sed research qu^Ftions and design- 
ing evaluations ?as an aid to organi- 
zational self -study and the 
development of effedtive program^ to. 
prevent youth crime. Y0 

*' » " f 

As evaluators j -we are assisting 

in the development of effective 

• • • ° • * »' 

projects critically assessing proj- 
ect effectiveness, and contributing 
to knowledge about ways • to .reduce • 
youth crime. At root , we share 'with • 
OJJDP and the legislators who . 
cheated that agency the conviction 
that the public deserves delinquency 
prevention and educational ef f'6r£s 
# whose effectiveness, has been 'demon- 
strated* In a Federal demonstration 
program such as the Alternative Edu»- 
cation Initiative, the expenditure • 
of public funds is justified by the 
evaluation of the resulting effort 
to learn how to develop and imple- 
ment similar prompts ef f ectively . 
The current evaluation, ^Ithough 
accounting for a small fraction of 
the cost of the Alternative EciucaT B 



tibn Program, ,has the important 
mission of summarizing and making 
available for transfer* to othexs, th$* 
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kriofal^dg'e gained in the broader pro- 
gram*. p a " . * - 

S. " * 

* ■ A ' 1 > 

We have. not assumed* that this v 
important task will be "easy to • * 
accomplish, a iand we are gratified 
that we have v been as successf ul^as 
we have bteen in translating our." 
ambi t ip ris in t o re a "ti. ty • Th e excel- 
X en t -rapport and cooperation we- have 
Vrtjv* the Fec|eral^ agencies irivolv.ed , 
and with most of the Action proj- 
ects, fra*ve teen critical in this 
success. f V ' 

This interim report summarizes 
gome of what we have* learned in the 
second year of the SAES. We' aiae 
pleased that evaluation is becoming 
roiitinized as an expected and well- 
understood part of the activities of 
mo'sf projects. \ .* 

i 

• . We are presently in a third year 
of interact iom^with 14 of the 17 - 
projects with** whom we began workings . 
in 19B0 — thbse that continue to 
operate* In most ca-ses, evaluation 
designs that are stronger than those 
possible in the fir.'t- two years are 
n.ow being implemented. Because 
sounder projects and sounder evalua- 
tion designs were avail^blg in the 
second year of operation th'an in the 
first, th^current report is" more 
informative in de scribing the 
4 effects of project interventions 
(than was our first ihterim .report . 
Future reports should be even niore 
productive in assessing • project 
effects on students and. schools. 

In our first interim report read- 
ers^may find information about ea , ch 
delinquency prevention project's 
history, ^its start-up activities, 
and its successes and problems in* 
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implementation during its first 
year. Alsb, in that report may be 
found, some organisational diagnoses, 
and some ideas* abqut improving proj- 
ects. Occasionally, % you will find 
preliminary attempts/Jo ' as sess„j 
effectiveness.. Tfiese ^preliminary * 
attempts were hot — nor we're .they 
intended tb be — authoritative and .. 
..conclusive, statements . .They were 
.intended to provide "inf ormatitm^use- 
ful for project development. 
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Effective projects develop over 
time jf incorporating feedback from ^ 
their own observations and those of 
evaluators to become stronger. This, 
second report is therefore, like the 
first, directed, primarily %o project Y 
iraylementers 'and to OJJDP % and it,8 
technical assistance confractor, who 
have a stake in fostering project / 
development or in planning new ini- 
tiatives. m This report also "contains* 
information about the Nprogress of * 'V . 
each project in adhi^ving tshie * 
results sought' by OJJDP # in its ini- 
tiative. Part »two* v of this re.port 
describes pach --in-dividual project \ 
separately, and focuses', on the . 
extent to which eaph individual 
project is meeting its own goals ^and 
objectives, and describes the prob- 
lems % and achievements of each. - 

. ■ 4 i 
AcknoyledRmen ts * 



This interim report 'is the pro-' 
% duct of many people'3 contributions, 
and it is possible to describe only ^ 
some 'of these contributions here. 
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upon.* < 
i . ' 
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Norm Ringel, and" Jane St. John, . 
worked long and hard with action * 
pro'ject ^personnel in workshops , site 
visit^,. and on the phonR to prepare 
for the surveys, to evolve Program ' 

•Development Evaluation plans ,^arid to 
draft ^project narratives. Lois Hybl 

'arranged workshdps, ^organized docu- 
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the project. Helene Kapinos k6pt/ 
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-tained our calendars, coordinated ( 
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assistants, and helped us^maintain 
tiie complex and massive d^ta. files 
created, by this large project.^ This 
report; is possible be caused of th<sir 
help and .practical wisdom. \ 

0 A\nf~Birdseye, Doris Coax^im, Bar- 
bara Dilligard, Martha , Stewart , 
Hilda Gutierrez , 'Glen Baderi Chester 
Wobfcen, Richard Snfith, Charles. •Almo, 
Jty4rman /Stef>toe, faary Lewis.-, ;Preston 
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Bill, Harris, David Bailey , • Anita 
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Denise C. Gottfredson performed 
the superhuman task of coordinating 
amMaanaging all of the data; Gary 
— Gottfredson and Donald E. Rickert 
modified % the survey instruments used 
;in the project's 'first year'. 
•Michael Cotfk, Deni'se Gottfredson, 
Donald Rickert, and Jan^St. John, . 
« put in many long days analyzing data 

under- great time pressure.* Others 
. who assisted with data analysis and 
management include : ■ Stewart Gavu- 
i^in, Richard D. Joffe, Robert Kir- 
chnery Helene .Kapinos, Abhijit 
, Mazumder, Andrea Nuzzolt), and Debo- 
rah. K. dgawa. - Raul Rometo trans- 
lated some new c items for the student 
questionnaire inTo Spanish, ar\d Den- 
's nis pillon' and Mary Ellen Hartmann 
of Intran Corporation produced the 
optically scannable instruments. 

Roberta Dorn and Barbara Tatem 
Kelley of the Office- for Juvenile 
Justice and Delinquency Prevention 
cleared the way for this project tOv" 
proceed, an^ helped to resolve t 
nearly countless problems along the 
way«. " 

Opinions expresssed are the 
V* authdrs' or editors', and do not 
necessarily reflect the position or 
policy of any ageticy or institution. 

Organization of the Report 

The- remainder of this report is 
organized into two secnions. The, 
fiVst^of tttese discussed topics 
relevant^to the entire study. Chap- 
ter 1 recapitulates in briefer form 
the first chapter of th4 first 
interim report to provide readers 
unfamiliar with the Alternative Edu- 
cation Program and" the School Action 
Effectiveness Study with a quick * 
introduction. Chapter • 2 recapitua- 
lates in' briefer form .chapters 2 
through*. 4^of the first intWim - 
report to acquaint those who* have 
riot read that document with impor- 
tant information about (a) the 
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.'record of ..accompl ishment in e.arliet 
delinquency .prevention 'efforts, . 
(*b) conditions netessary to make 
• inferei\Ges about prevention project 
, effectiveness > and- (c) program, 
development evaluation. Chap.ter 3, 
descr ^fres*changes made in the meas- 
ures* ijysed in the school action 
effectiveness study, summarizing the 
. psy.cfiometri^c properties of instr-ur 
mefnts redesigned fpr easier compre-* 
pension by school/officials or ' * 
improved through new research . 
*-C.t&apt'er 4. provides brief descrip- 
tions ^of the kinds ^of delinquency ?l 
p rfev en t io'n pfc o j e c t s in the in i t ia- 
tive- It- also describes major 
influences on\ the evaluation and the 
development of the prevention proj- 
..ects during the second year of the 
' Alternative Education Program. 
# Chapter 5 provides an overview of 
the school-level evaluation results^, 
for the re Sul ts sought by'OJJDP.. 
Chapter 6 summarizes information 
about .the effects of interventions 
targeted at high-ris'k individuals., 
for prbjects that have such targeted 
interventions as distinct;* evaluata- 
' ble components. Chapter 7 draws 
impl ica tions of the study that seem 
appropriate at the present time, and 
makes recommendations for. future, 
work to. reduce youth crime. ' 

Part II of this reoort consists 
of independent reports on $he pre- 
vention project . Most chapters were 
drafted by the field worker assigned 
t o, th^J&r'oject . 1 Therefore , ; they 
general ly\ have the benefit of having 
been given) direct attention by the i 
member^pf^the ^valuation team most' 
familiar with that particular alter- 
native educat ion pr oj eot . At thti 
s ame time , 'however , the involvement 
of multiple authors, eachTwith a 
different background, and perspective 
on evaluation, leads to some 'uneven- 
nesjs in pr e $en t a t ^O.n . Some au thor s 
have bluntly 'provided the gob'd and 
the bad news in a straightforward 
.fashion. 4 Otjhers have leaned toward 
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presenting the projects j.n ways that 
mafce their strengths salient. In 
the editorial process we have not 
tried t<r eradicate the personal and' 
stylistic differences that exist 
'among the authors, of the separate 
Rroject reports. The reader is > 
therefore urged to consider each of 
these a dist.inct essay, and to avoi'd 
"making* comparisons across projects 
onV the* basis of thesie -individual ly 
drafted accounts. Many readers may 



be interested in reading Part* I .of 
this report, selectively dipping 
into Part II to learn more abouit 
specific projects. 

... , < » 

^Appendices contain detailecf| sta- 
tistical! tables and other material 
relating to the results summarized x 
in Past. I. 

\ . * . Gt)G 
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Introduction to- the School 

The Alternative* Education jprogram 

The Office of Juvenile Justice 
and Delinquency Prevention * (OJJDP*)^ 
funded 17 demonstration projects in 
"the f^ll of 1980 and the early 
months of 1981 as part of a Program 
in Delinquency Prevention through . 
Alternative Education. This OJJDP 
initiative is premise4 in part on 
the observation that delinquent 
behaviot is associated with a number 
of school-related or school-based 
problem^, including disruptive 
classroom conduct , absenteeism , 
truancy, and dropout (Bachman, 
..ti'Malley,. & Johnston, 1978'; Gott- 9 
v fredson, 1981, 1983b; OJJDP, 1980). 

An educa t ; approach to de 1 in- 

quency prevents is strongly sug- 
gested by the most widely inf luen- 
cial contemporary theory of 
delinquency (Hirschi, 1969), in 
which commitment to educational or 
other conventional goals, at'tach- 
meats to teachers and the school, 
and belief in rules are viewed as 
bonds of social control which pre- 
vent delinquent behavior. Learning 
theory, especially social learning 
theory (Bandura, 1971 X, provides an 
explication of the ways in which 
these elements of the social bond 
may be strengthened by appropriate 
educational interventions. Social 
learning theory also helps to 
exp lain how the influence of al ter- 
native school organization, and the 
inf luence \of peers , teachers , and 
parents, can converge, in preventing, 
or failing 1 to prevent, delinquency. 
These theoretical perspectives find 
substantial suppor t in the ev idence 
provided by research; they concur in 



For a more extended discussion of 
the topics presented here, see the 
first interim report 



Action Effectiveness Study r \ . ( 

imply ing that alternative educa t ion 
programs can be structured in way6 
that* will reduce delinquent behayior 
(Gottfredson, 1983b; Hawkins & Wall, 
1979). 

■ i 

i j 

Both primary and secondary pre- 
vention of delinquency might be j 
a chieved in al ternative education 
programs through their effects on 
the academic and social development 
of the youth involved. A . j 

i. 

The demonstration program is ^for 
the most part targeted at schools 
' -serving grades 6 through 12 in rela- 
tively high crime communities, with 

* high rates of delinquency, dropout, 
suspensions , expulsions , absentee- 
ism, and youth unemployment. Proj- 
ects funded as part of this program 
were to be aimed' at achieving I 
(a) decreases in delinquent behavior 
in arid ar'ound schools, ^(b) decreases 
in dropouts, suspensions , Expul- 
sions, and truancy, (c) increases^in 
attendance, (4) increases in aca- 
demic success in school with conse- 

. quent increases in graduation jrates , 
and (e) improvements in the early, 
post^chpol ing labor market experi- 
» ences, or in the post-secondary 

training or education, of youth ^ 
associated with participating! ' - 
schools. The .first of. these (results 
sought is known to.be associated 
with the results "b" through I n d ,! in 
. the foregoing list, which ar£ gener- 
ally regarded as important risk fac-\ 
tors for subsequent delinquent 
behavior. The final result /sought 
would likely be influenced ^by inter- 
ventions that reduce the ripk of 
delinquency, an<J is of special 
/importance to the Department of 
j Labor (which transferred fiends to 

/ OJJDP to support part of ttiis initi- 

/ ative). 'j 

/ • . / ' 

The achievement of these objec- 
tives requires some reorganization 

/ r 
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of school policies, practices, and , 
Environments. Specifically , the 
OJJDP program announcement called 
for achieving the following objec- 
tives which were seen, as insf rumen- 
tal in* fostering the attainment of 
the overarching program goals: 
(aT limiting or decreasing referrals 
to the juvenile justice system; 
(b) making school discipline fair 
and consistent while providing for 
due process; (c) increasing youth, 
parent, and community agency parti- 
cipation in school decision making 
to reduce student alienation and 
feelings of powerle^ssness ; 
(d) decreasing the grouping of stu- 
dents according to inappropriate 
criteria (such „as social class or 
rac&) which, accompanied by improved 
learning environments, should pre- 
clude labeling effects and stigmati- 
zatidn while enhancing educational 
success; and (e) providing a struc- 
ture for learning that promotes edu- 
cational and social development 
because it is tailored to realistic 
levels of performance for individual 
students. 2 

Some of these instrumental objec- 
tives are in accord with research' on 
the characteristics of schools and 
communities that are associated with 
victimization (Gott:f redson & Daiger, * 
1979; National Institute of Educa- 
tion, 1978)*. Others accord with 
advice offered by national advisory 
panels (e .g. , President's Commission 
*on Law Enforcement and Administra- 
tion of Justice, 1967),; or practi- 
tioners (McPartland & McDill, 1977). 

• - ? / 

These^ OJ JDP-generated project 

specifications constitute the first 
of three bases for an evaluation. 
The second basis is^ goals and objec- 
tives of each of the seventeen 
delinquency prevention projects. 
The third basis for the evaluation 
is the broader literature on the 
prevention of youth ct(ime, which 
specifies some intermediary objec- 



tives that are important for 
del inquency prevention efforts (see 
Gottf redson, 1981 , and Empey, 1981, 
for reviews of this literature). 

Evaluation Aims 

The overarching goal of the 
School Action. Ef f ectivenfcss Study is 
to create transferable and scien- 
tif ically sound knowledge about, 
delinquency prevention theory and 
practice; But a complex evaluation 
such as the School 0 Action Effective- 
ness Study must accomplish many aims 
if it is to be effective. As Ogawa 

^ 1982) makes cl ear , pr ev ious del in- 
quency prevention efforts and their a 
evaluations have been fraught with 

iproblems of incomplete implementa- 
tion, weak evafufetions , arid lack of 
intermediary and outcome measures 
required to assess the efforts. • 

Not only de 1 inquency prevention 
programs suffer from'these problems. 
- Sarason (1971) -describes the disap- 
pointing, degree of implementation of 
attempted * educational innovations 
such as the "new math." Where.as the 
developers of the innovation 
intended to- alter the ways teachers 
interact with students, „th£ major 

r * outcome was the use of some new math 
books. Many educational evaluations 
are, as Charters and Jones (1973) 
put it, evaluations of "non-events," 
Likewise, theory, is lacking in many 
delinquency prevention and correc- 
tional pr ograms ,^but is an essential 
element in the programs and their 
evaluations (Empey, 1980; Glaser, 
1977; Gottfredson, 1982a). The S^ES 

y has taken steps, to avoid evaluating 
non-events, anc^also to avoid the 
ottier problems from which earlier 
prevention evaluations have suf-' 
feried. ' \^ 

Reducing youth cr ime . in America 
is bound to be at least ; as difficult 
as building a space shuttle.. But \ 
those who env is iorv programs to pre- \ 
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vent delinquency or £o rehabilitate 
youthfu? offenders all too often 
hope for effectiveness without 
developing plausible plans or using 
the technology needed to raise theif 
inert and clumsy progtams from the 
ground. Developing effective pro- 4 
grams to reduce youth crime will not 
be easy. Mich worthwhile technology 
has been developed, but>usually this 
technology goes underutilieed or is 
misapplied in schools . c 

The history of previous delin- 
- Iquency prevention efforts implies 
that .most previous programs have 
been poorly implemented, implausible 
from the outset, or poorly evalu- 
ated. .This history implies that 
concerted effort is required to 
implement highly plausible programs 
with strength and fidelity, and 'to 
evaluate these programs rigorously. 

The scientific literature pro- 
vides good^ reason to believe that, 
the risk pf delinquent behavior can 
be reduced, the evaluation litera- 
ture provides strong grounds for 
insisting on strong, theoretically 
based, and well evaluated^ programs". 
The School* Act ion Effectiveness 
Study was designed to strengthen the 
projects being, implemented in the 
Alternative Education Program, eval- 
uate them rigorously, and creat^- c - 
transferable knowledge about delin- 
quency prevention . 

Planning and Implementation 

The history of evaluation 
research in de linquency prevention 
is replete with examples of programs 
in which the implementation was 
undocumented or s not carried out as 
planned (Dixon .& Wright , 1974; Kri$- 
berg, 1978; Ogawa, 1982). Knowing 
the fidelity 'with which program 
plans are implemented/ the strength 
of the "treatment," and the context 
within which the program operates is 
essential for three reasons. First, 
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any evaluation result — either 
positive or negative — is of little 
valud unless the rlature of t-he pro- . 
gram is well' described. Second, : 
information derived from monitoring 
the activities and. the implementa- 
tion of plans is riefeded to 
strengthen the integrity of the pro- 
gram, and to detect unforseen conse- 
quences or potential breakdowns- in 
project plans or the evaluation 
design.. Third, negative results of 
summative evaluations have sometimes 
led observers to conclude that the ^ 
interventions intended to be imple- 
mented, do not wcfrk, whereas the" 
interventions may not in fact have 
been implemented , imply ing a quite 
different conclusion (Sechrest^ 
White, & Brown, 1979)., Knowledge of 
what was actually implemented is 
essential in drawing conclusions 
from tests of any planned interven- 
. tion. 

.Strength arid integrity of planned 
interventions . Assessment of the 
planning an 3^ implementation process 
consists of two distinct components 

. (Sechrest, West / Phillips Redne-r , & 
Yeaton, 1979). The first relates . to 
considerations of the strength of 
the intervention plan. This is 
essentially a matter of the con- 
struct validity of the* measures 
intended to be taken in an interven- 
tion. Several procedures are avail- 
able to assess the strength of 
delinquency prevention programs. 
These include: (a) analysis of* the 
plausibility of the plans' theoreti- 
cal premises, and de termination* of 
how closely the specifics of the 
plans are linked to delinquency pre^- 
vention theories; (b) expert judg- 
ments about, the likelihood that the 
project as specified will produce 
the desired outcomes; ,and 
(c) comparisons of -the intended pro- 
grams with the range of current or 

'. past effiorts'at delinquency preven- 
tion (in this way a program that was'" 
otherwise unremarkable but resembled 

- IB • ' V. ••• 
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a previous inef f ective ef fort fright . - 
be judged . a- weak program). In addi- 
tion to a theoretical b^sis, parame- 
ters involved in making assessments . 
of strength include staff stability 
or qualifications, intensity and 
juration of treatment, focus of 
effort, clarity of plans, and the 
extent -to which the plans involve . 
different responses to-different 
persons (e.g., individual ized 
instruction). In general, replica- 
tions of previously tested or well 
engineered interventions, comprehen- 
sive attempts to cope with the mul-, 
tiple causes of a problem, treat- 
ments with clearly spelled oiit 
treatment protocols or implementa- 
tion manuals, or pr imary prevention- 
efforts that a£fect a substantial 
proportion of an environment's inha- 
bitants are likely to be stronger 
than* those that lack these charac- 
teristics. 

The second aspect of assessing 
program implementation relates to 
the integrity >or fidelity with which 
/ pl^ns are implemented. Clear plans 
/'are more likely to be implemented 
with fidelity than diffuse plans, 
fuzzy promises, or vague project 
descriptions. Some components of 
implementation that must bp moni- 
tored or observed are (a) staffing 
patterns (including experience, 
training, numbers, and stability), 

(b) methods used to select, adnq-t, 
of reject the youth involved in each 
project and each of its components, 

(c) the differential assignment of 
youth to alternative^ programs , or 
the basis for individualization of 
instruction, (d) the' Wture, dura- 

- tion, circumstances, and frequency 
of services to individuals or ^ 
groups, (e) methods>usfed to deter- 
mine^wfio (including students) is 
involved' in implementation^ (f ) the 

* interventions' elements' and their 
.duration, (g) the degree of project 
staff commitment, (h) project super- 

' visory and management practices^ and 
(i). ciirricular materials^ 



individualized education plans, les- 
son plans diagnostic protocols, \, 
treatment plans, 'and the like. 

The importance of this aspect of 
assessing implementation can • 
* scarcely be overestimated.. The ^ 
s cope of the al ternative education 
action projects, encompassing as 
they do many distinct components', 
makes the faithful implementation of 
all plans unlikely • A failure tb 
obtain sound evidence about the 
strength and integrity of these pre- 
vention projects could lead to erro- 
neous conclusions about the efficacy 
\of the delinquency prevention ideas 
behind these, projects. 

\ v - * ' 

Evaluation, the Sponsor, and the 
Action Protects 

The\Al ternative Education Program 
is sponsored by the Office of Juven- 
ile Justice and Delinquency Preven- 
tion, with supplemental funding pro- 
vided through OJJDP by 0 the 
Department of Labor. Ttferee divi- 
sions of OJJDP are involved directly 
in this program. First;, the Special 
EmphasTs Division has programmatic 
responsibility for* the grant awards 
made to the 17 action projects 
listed in Tables 1 and 2.* Second, 
the Technical Assistance and Train- 
ing Division has responsibility f6r 

' providing assistance in project 
development, and. works through con- 
tractors to' do so. * Initially,, the 
Westinghouse National Issues Center 

• wa,s assigned these, technical assist- 
ance tasks as part of its larger* 
contract to provide assistance for 
OJJDP' s Delinquency Prevention 



jl . An lffth project was funded, too 
f late to be included in this evalua- 
, tion/. Initially defied a grant 
under the Alternative*- Education -Pro- 
gram*, it successfully challenged 
this denial and was^ eventually 
awarded a grant. 
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Research and Development efforts. 
Late in the first year of operation 
Of the Alternative Education Pro- 
/gram, Westinghouse was replaced by 
o Polar is - Research and Development in 
this role. Third, the National 
Institute for Juvenile Justice and 
Delinquency Prevention* is .responsi- 
ble for the evaluation. The insti- 
tute made a grant to the Johris Hop- 
kins University to perf o'jjnn fthis 
evaluation, and the University sub- 



contracted part of the work to its 
collaborator , the Social Action 
Research Center. In .short, a total' 
of 23 organizational entities are 
directly involved in this effort. 
The participation of each is essen- 
tial to the successful conduct of 
the evaluation. Tl^e degree of col- 
labojat ion and v Jcoopi6ration among 
these groups has generally been 
exemplary . 



/ 
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Elements of Effective Program Development and Evaluation' 



Past Efforts 

Examples of highly plausible; 
well implemented, and carefully 
evaluated delinquency prevention 
projects are extremely rare, Dixon 
•and Wright (1975) reviewed*95 delin- 
quency prevention reports published 
after 1965 and concluded that there " 
is a paucity of evidence about the 
effectiveness of existing programs, 
Dixon and Wright at tributed part of 
the unTntflrjessive record of .accom- 
plishment in this area to unclear 
project objectives, difficulties in 
implementing rigorous designs. and 
collecting meaningful measurements, 

.More recently Krisberg (1979) 
reviewed 16 exploratory delinquency 
prevention projects funded by OJJDP. 
After the first year of- 'operation, 
only one of these projects tfed 
implemented kv en a quasi-experimen- 
tal design. Not only were most.^of 
the projects unevaluatable because 
of problems in data collection and 
the lack of comparable control 
groups, but { none of the 16 projects 
had articulated a useful theory 
about delinquency in their catchment 
areas or spelled out how their ser- 
vices would reduce the problem, 
Krisberg concluded that ^J>als were 
often too ambiguous,, not clearly 
related to the problems the projects 
W?re. intended to address, and that 
projects had engaged in incomplete 
planning. 

In j short, most^pr'evious evalua- 
tions in the delinqeuncy prevention 
area have suffered from evaluation 
design flaws, the use of irrelevant 



For a more extended discussion of 
the topics presented h£re , see chap- 
ters 2 through 4 of the first 
interim report . 



measures or no jneasures at al^j^ * 
dependence on a single source of 
information, a dearth of theory,' and 
ambiguity about intent. 

There are, however, a few good 
e xamp 1 e s of de 1 inq ue n cy pr ev eh t i on 
demonstration projects. The Empey 
&nd Lubeck (1971) and Empey and 
Erikson' (1972) reports show how 
theory can be integrated with delin- 
quency prevention efforts. And 
Alexander and Parsons (1973) illus- 
trate a family intervention that 
involved, (a) a clearly described 
intervention, (b) process evalua- 
tion, (c) careful summative evalua- 
tion using clearly defined and non- , 
reactive behavioral criteria in a 
persuasive evaluation design; Simi- ; 
larly, 1 the results of intervehtions 
described by Reid and Patterson 
(1976) are impress'ive. These few 
examples illustrate that high,.qual-' 
ity and well evaluated projects can 
be implemented, * 

The present evaluation -attempts 
to build on the previous experience 
in this area "to anticipate and avoid 
as many pitfalls as possible. We 
aim to clarify prevention project 
goals and theory and their linkages, 
with short-term or intermediary 
obj ectives and the intervention's 
aimed at bringing these objective 
about. We also aim to facilitate 
the development of workable struc- 
tures for managing project implemen- 
tation and evaluation. 

Inferences about Project Effective- 
ness . * 

Once a project has implemented a 
plausible intervention intended to , 
influence student at titudes , behav-' 
ior, or development ,. assessing tjie 
consequences of that ir- LerventiGn 
becomes important. Making this 
assessment is not always easy. 
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Young people are grow-j^g and 
changing all" the time. >Uite6 of 
participation- in delinquent behavior 
apparently' rise and then fall with 
v age. Scholastic competencies usu- 
ally grpw over time, but at differ- 
ent rates for different people. 
Students make new friends and aban- 
don old Qnes, and every parent krfows 
that his' or her child's tendency to 
conform or rebel, is different at 
different stages of developments 
Isolating the influence of some spe- 
cific experience \ intervention, or 
set of interventions is there£ore 
difficult. 

Making inferences about the. ' , 
causes of some difference yi student 
outcomes — about the effects of % 
planned interventions--is , however, 
a major goal of evaluation. Put 
another way, an aim of a thorough^ 
evaluation, is to determine whether 
an observed difference in studect 
behavior or attitudes (if any diTf- * 
ference is obsetved at all) can rea- ; 
sonably be attributed to a specified 
interyention. Certain conditions 
make, the search for the effects of . 
an intervention easier; other condi- 
tions preclude making any confident 
inferences. An excellent discussion 
of the conditions that make^infer- 
ence possible is provided by. Cook 
and Campbell (1979)% and readers may 
want to consult, their book for ela- 
boration. 



Creating these conditions is what 
evaluators mead by "evaluation 
design." Mos^t projects participat- 
ing" in the Alternative Education 
Frog tarn did^not anticipate fully/ the 
need- tb create 'rigorous evaluation 
designs. In the first interim 
report, we described at length a 
number of objections- raised at one 
.time or antfther by project imple'men- 
w ters to the rigorous evaluation of 
their 7 projects. - , 



T he Current Eff ort , 

A major accomplishment of the 
Alternative Education Program in its 
first two years of operation is that 
it has succeeded in implementing 
evaluation designs for a number of 
the prevention prqjects that are 
much stronger tfyan those typically 
found in this area. In the second 
>\ear of operation, $ix projects suc- 
cessfully implemented, true random- 
ized field trials. Several other 
projects implemented careful ly 
thought out quasi-experimental 
designs. < 

* * . 

A second major accomplishment of 

the" Alternative Education Program in 
its first two years of operation is 
that, it r has succeeded in collecting 
outcome measures that are clearly 
r elevant to £he Program 8 goals . 
Whereas the collection of informa- 
tion about delinquent ^behavior was 
resisted by several projects in the 
first year of operation, by year two \ 
only one project was unable to'' 
assist the evaluation in collecting 
this information (the Harlem proj- 
; ect). 

Strengthening Prevention Proiects 
through Evaluation / 

A Program Development Evaluation - 
(PDE) method provides the structure 
for the evaluation of the various 
(projects in the Alternative Educa- 
tion Program. This method is 
intended to anticipate and foster 
the development of these projects by 
involving project personnel in a \^L. 
cycle of evaluation activities* The 
method is intended to (a) make rig- \ 
oroy's evaluation possible, (b) make 
-the evaluatibn» relevant not only to 
national concerns but also to the 
concerns of project a personnel and 
managers, (c) document pr'oject 
implementation, (d) facilitate proj- 
ect implementation, (e) tie the 
evaluation expl icitly to theory , and 
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(f) integrate research with project 
operation*! so' that projects develop 
by lining theresultu of research in • 
project planning. Related etruc- 
tuvcB, differing somewlut In 
detail, are provide^! by lunpey (1980) 
and Thorp and Gallimoire (n.d.). 

JPDK / 

The Program Development Evalua- 
tion method provides this strategy 
and structure , in part through the 
following components (for more 
details, see the first interim 
report; or §er> Gottfrcdoon, 1982a; 
and Gottfredson, Rickert, Gottf red- 
son, & Advani , 1983). 

Clear Goals . A project without 
clear goals is on the road to 
nowhere. Clear measurable goals 
help a project focus its activities 
and they provide an integrating ✓ 
theme for a 'ielinquency prevention 
effort. In using the PDE method, 
researcher?, and project implementers 
woifkr together to design an agenda to 
achieve clearly articulated goals. 

Explicit Theory . Theory helps to 
organize knowledge, provides a guide 
for developing or selecting an 
intervention, and provides a base 
for assessing the program's effec- 
tiveness. Behind every delinquency, 
prevention' project lies a set of 
ideas, or practical "theories." If 
left unajrticulated, these ideas pro- 
vide little guidance for .project ! 
development. The more carefully 
thought through these ideas are, £he 
more useful they are in guiding 
.project decision making.. 

Intervention . The program compo- 
nents — the actions taken by a pro- 
gram to move, closer to achieving its 
goals — are rooted in clear-headed 
thinking about goals and the pro- 
gram's theory of action. Interven- 
tions are implemented with an exper- 
imenting spirit. Each element of a 

-11 
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program can be evaluated through 
evidence about ( how well it i« % Wring' 
.implemented and what it is accom- f 
plishing. 

• Forcefield Analysis . All actions 
occur in a dynamic program environ-, 
ment in which available resources* 
co-exist with obstacles to action. 
Initial analysis of th is Torcef ield 
increases the likel ihood that inter- 
ventions and research designs will 
be* implemented as* intended, But o 
periodic further analyses are 'needed 
because initial analyses may be 
incomplete, or incorrect, because 
perceptions change over time, an.d 
because the project's actions change 
the f orcef ield. 

Plans . * Ef f ective programs derive 
plans for implementation that are 
derived' from the forqef.ield analy- 
ses; they use available resources to 
overcome obstacles to implements- ' 
tion. fully articulated' pldn 
includes ^standards for implementing 
each intervention and managing the^ 
overall program. A careful plan 
details each $f the following: 

o Cr i fr'i ca 1 benchmarks — key po int s 
at which a decision, agreement, 
action, or arrangement must 
oefcur to keep the prej&ct moving 
forward. 9 

o Implementation standards — ob- 
servable quality control stan- 
dards that let everyone Jjivolved 
with a program* know what consti* 
tutes acceptable performance. 

o Task statements — Details of who 
will do what by when . 

Ongoing Process ; 

The Program Development Evalua- 
tion method stresses the collabora- 
tion of researchers and project * 
impleme^tor s at each and all stages 
of the change process. . The develop- 
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mental expectation is symbolized in 
1 Figure 1, which illustrates the com- 
ponents of the PDE method. In 
applying this method, a detailed 
Program Development Evaluation Plan 
is created together with implemen- 
ted* of each project. The manage- 
ment plan for the program is compu- 
terized, ; and is updated every six 
weeks. Quality control checks on 
the implementation of the plan are 
made frequently by project implemen- 
ted, and information on the accom- 
plishment of key performance stan- 
dards, objectives, and goals is 
entered 'into the computer.*** Informa- 
tion flows from the -projects- to the- 
researchers and back again as a spi- 



ral of program development unwinds. 
Information feedback is used to 
improve .the prevention programs and 
the ways they are managed. 

N We have attempted to .apply the 
foregoing method with all of the 
projects involved in the Alternative 
Education Program. We have, of 
course", met with mixed success . The 
magnitude of the task of working 
with ^so many projects with extremely 
1 imited' resources has meant that 
even in working with those pr.ojects 
most eager to implement this method 
we have not implemented it nearly as 
.fully as wo^xld be 'desirable, 
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Ari Update on the Measures used in the School Action Effectiveness Study 



Measurement is a central compo- 
nent of sound program development 
efforts, and measurement is essen- 
tial in program .evaluation- This 
chapter is a guide to using and , 
interpreting measures of school cli- 
mate, individual psychosocial devel- 
opment, and delinquent behavior that 
are used in the Alternative Educa- 
tion Evaluation. It serves as a 
manual* to help readers interpret 
results of the School Action Effec- 
tiveness— Stttdy^ — ~" 



Measuring Individuals and Organiza- 
tions 

A two-tiered set of measures are 
used to assess the outcomes of the 
Alternative Education Program. One 
tier assesses the characteristics of 
individual students and individual 
teachers that are relevant to organ- 
izational climate, or to important 
personal outcomes. The other con- 
sists of school-level climate meas- 
ures that directly assess some 
important dimensions on which 
schools vary. 



The psychometric work "repor ted 
here was sponsored in part by a 
grant from the National Institute of 
Education, U.S. Department of Educa- 
tion. The opinions expressed do* not 
necessarily reflect the positions or 
policies of any agency. This chap- 
ter is abridged substantially, but 
covers some material covered in the 
first interim report, and it reports 
on improved methods of presenting 
results. Material presented in some 
de'tail in the first interim report,, 
is repeated here because it is 
necessary for an understanding of » 
the results presented elsewhere in 
this report. 



The measures are divided into 
these two classifications for an 
important reason. We have all 
experienced differences in the psy- 
chosocial climates of different • 
organizations , and we can easily 
appreciate that organizations differ 
in the environments that they pro- 
• vide. Yet we also know that differ- 
ent individuals often have different 
views of the characteristics of the 
same organization. Therefore, in 
~~ assessing a given climate, it is 
important to average across many 
different reports — in essence 'treat- 
ing individual differences as error. 
These differences are, however ,^fcfre 

• very reason we measure individuals. 
Accordingly, two distinct sets of 
measures are called for. Besides 
the general cl imatet assessments , 
individual measures are needed for 
personalizing instruction and for 
comparing the effectiveness of . 
alternative educational treatments 

* received by some people in a given 
^school or community. ^ 

The measures described here were 
developed specif icrilly for the 
School Action Effectiveness Study 
(SAES) because no' comprehensive and 
psychometrically adequate battery • 
was available elsewhere. They are 
rooted directly in a program of 
research on delinquency and schoql ' 
environments conducted over the. past 
several years at the>Johns Hopkins 
University. The development of the 
instruments used was.guided in part 
by an examination of instruments 
used in the National Institute of 
Education's (1978) Safe School 
Study, instruments suggested by Fox 
and associates (19/^), the School 
Initiative Evaluation questionnaires 
(Grant, Grant, Daniels, Neto, & 
Yamasaki, 1979), and a number of 
other instruments usej} in major 
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social surveys or for individual 
assessment in recent years. Rele- 
vant items (with necessary modifica- 
tions) from other devices are some- 
times used. 

Decisions about useful measures 
ajp^ based on a review of the goals 
and objectives of the OJJDP Alterna- 
tive Education Program and of the 
various alternative education proj- 
ects being evaluated, on current 
delinquency theory (Hirschi, 1969; 
Gold, 1978; Lemert, 1972; Greenberg, 
1977) on Gottfredson's (1983b) 
account of some implications of 
delinquency theory and strategies 
for organizational change. Many 
discussions with prevention project 
personnel — using the Program Devel- 
opment Evaluation framework — of the 
goals and objectives of their parti- 
cular delinquency prevention efforts 
contributed greatly to the formula- t 
tion of the measurement needs. * * 

Some Essential Psychomet ric Concepts 

In order to use the measures 
about to be described in an informed 
manneT,' it is important to under- 
stand several ideas: (a) the rela- 
tive nature of psychosocial measure- 
ment, (b) reliability and (c) 
construct validity. 1 The following 
paragraphs review these ideas.' 

Relative Measurement 

We have few absolute measures in 
behavioral science. In other words, 
simple counts of "units" of achieve- 
ment" or interpersonal competency or 
fairness or delinquency are impossi- 
ble to obtain. Instead, we typi- 
cally express their levels in rela- 
tive terms. For example, 
achievement test results arc often 
presented in terms of percentile 



1. For more thorough discussion see 
Thorndike (1971). 



rank or staB<ter<L__score form. These 
forms of expression involve state- 
ments of the standing of an indivi- 
dual (or organization) relative to 
some norm group of people (or organ- 
izations). For example, a percen- 
tile rank of 76 on an individual 
test would mean that out of 100. 
individuals representative of the 
population on which the test's norms 
are based, 76 persons would have a 
score lower than this one. We use 
both percentile ranks and raw score 

means and standard deviati ons to 

— present resulTs^ Or tie mean is tne 
^arithmetic average of a set of 
^scores, and a standard deviation is 
a unit of dispersion or spread.) 

In interpreting such scores it is 
impprtant to bear in mind that they 
express scores relative to other 
scores in the study sample. Differ- 
ent sampLes of people or of schools 
will differ somewhat in their means 
scores (and also in their disper- 
sion). Therefore a score that is, 
for example, at the 65th percentile 
relative to one norm group could be 
at the 30th percentile relative to 
another norm group. 5 There is no 
such thing as a magically "correct 11 
or even "most appropriate" norm 
group. 

^Please note that the psychometric 
use of the word "norms" has little 
or nothing to do with some everyday 
language uses of the word. In 
everyday language we sometimes use 
"norm." to mean an ideal or required 
. standard. It is quite possible for 
a school to hav£ students who show 
an "average" degree of satisfaction 
with school but who are rathSr 
uncomfortable— or who are average in 
reading achievement according to 
large city norms, but who do not 
read well at all. In interpreting 
any particular results, readers 
should probably consider both their* 
own "ide*al" norms and the "statisti- 
cal" norms presented here. 
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Reliability 

• * 

Chance, sloppiness, ambiguity, 
temporal instability, and hetero- 
geneity of meaning >or interpretation 
can influence any measure. Measure- 
ments of the distance between Balti- 
more and New York made by the odome- 
ters in a number of different cars 
would tend to agree pretty well, but 
not perfectly . t TJiey would have 
high, but not perfect, reliability. 
Reliability- is^a technical term used 
to describe the relative contribu- 
tions of measurement error and 
"true 11 8 co^ ^vk^ lability to a scale 
or other measurj-T! Technically, 
reliabilityVis^ the proportion of the 
variance (a statistic summarizing 
variability) that is not error to 
the total variance in the score. 
Because there are many ways of 
defining error, there are many ways 
of estimating reliabil ity '(Stanley , 
1971).. 

Ttve reliability coefficients 
reported in this chapter are of two 
kinds.. One kind is based on the 
analysis of items administered on a 
single occasion and * therefor e (1- ^ , 
excludes temporal instability from / 
the definition of error. They can/ 
be interpreted as an index of how 
well the scales measure whatever 
they measure at a given .point in 
time. This kind of reliability 
coefficient is called k "homogene- 
ity" coefficient; we estimate it 
using coefficient alpha.-* The second 
kind is based on the stability .of 
scores ov.er .time.- We estimate it by 
correlating scores obtained by indi- 
viduals or schools in the Spring of 
1981 with scores for the same indi- 
viduals or schools obtained in the 
Spring of 1982. This kind of reli- 
ability estimate is called a 
"retest" reliability; it is a meas- 
ure of the stability over time of a 
score. 

Knowledge of the reliability of a 



test or other index is i important 
because a low homogeneity coeffi-c 
cient means that the device does not 
^measure anything well. A ; high homo- 
\geneity coefficient means that the 
device measures something . (What 
that something is, is j what construct 
validity is' all about.) Homogeneity 
coefficients can ran^e from 0 to 
4.0. A reliability of 1.0 is high, 
meaning that the score contains no 
.error. A high retest reliability 
means* that a Stable /character istic 
of a person or organization is being 
measured . High re test reliabilities 
may mean that (a) tnq characteristic 
is resistant to change, (b) that the 
environment is preventing the indi- 
vidual or organization to change, or 
that (c) nothing has been done to 
change the characteristic. 

Over the years / practitioner s have 
developed rules 'of thumb for accep- 
table levels of reliability for dif- 
ferent purposes. 1 In general, it is. 
riot sound practice to use tests with 
reliabilities tmuph below *1 or .8 
for individual- diagnosis,, personnel 
decisions, and so forth. This is > 
because one wouljd want to be reason- 
ably certain that a score* is reason- 
ably erf or-f reel when making impor- 
tant decisions about individuals . 
When -interpretations of patterns or 
profiles are to be made, it is espe- 
cially important that reliability be 
this high, or higher. 

■ l ■ ■ ' ' 

' For evaluation purposes, lower 
Levels of reliability of measurement 
at the individual level are accepta- 
ble and are sometimes to be prefer- 
red, because* of three related^ con- 
siderations. I First, because the / 
scores ojE many individuals are usu- 
ally . averaged in an evaluation, / 
dependable estimate's of true-scc/re 
means can be I obtained even wit 7 h 
rattier unreliable individual meas- - 
ures (see Stanley, 1971). Second, * 
the longer the scale (i.e.^ the more 
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items), the more reliable f it is , 
other things being equal, but it is 
of ten difficult , time consuming, or 
cos tly to administer long scales . 
As an alternative, using short . 
scales with many persons gains good 
estimates of group means. Third, in 
an evaluation ib is necessary to 
measure many things. This is 
because prevention programs have 
many goals and objectives, and 
because it is always wise to search 
for "unanticipated posi-tive outcomes 
or side-effects of a program. But 
administering many highly reliable 
(i.e., long) scales is prohibitive. 
Fortunately , a large test group 
again tomes to the rescue. Using 
short scales with mariy # people solves 
the problem and yields satisfactory 
estimates of true-score means. 

As a i:\xle of thumb, scales wi-th 
reliabilities as low as .5 (or even 
lower) are adequate far use in an 
evaluation, provided that the proj- 
ect being evaluated uses randomiza - 
tion as a selection device, or that 
any selection is absolutely indepen- 
dent of (i„e.» unrelated to) the 
goals or objectives of the program. 
In such ah evaluatibn, it is not 
necessary to attempt to adjust for 
prevexisting or spurious group dif- 
ferences on outcomes. When it is 
necessary to makef such adjustments 
by using statistical "controls," 
reliabilities for the control varia- 
bles must be as high as possible. 
The rule of .5 is too lax in this 
case because when the "control" 
yariables are unreliable they do an 
inadequate job of correcting for 
spurious differences" between groups. 
Therefore, to enable a /saund evalua- 
tion, a project which does not ran- v 
domize should use more reliable 
(i.e. , longer) scales encompassing 
measures of all relevant character- 
istics in which 'the treatment and 
comparison groups may differ. 



Validity, 

Validity has to 'do with the mean- 
ing and interpretation of an index 
or score. The exploration of mean- 
ing is a never-ending process, 
because it is* so closely linked with 
theory . Theory involv.es constructs 
or ideas abo\it the causes or nature 
of phenomena* Often, measurement 
has meaning only in the context of 
some theory.' For example, some edu- 
cators have a theory that a general 
ability called intelligence under-, 
lies much human performance, or at 
least scholastic achievement. The 
measurement of intelligence using a 
paper and pencil verbal ability test 
may make sense in terms of this 
theory . Because the theory predicts 
that this test will correlate with 
school grades, evidence about the 
validity of a test for 'measuring the 
construct of* intelligence can come 
from^an ' examination of the empirical 
relation between test scores and 
school grades. The same evidence 
provides information about the util- 
ity of the, theory. Theories and 
measures are thus validated in a 
common process. We speak of a test 
.as validated when ' empirical evidence 
has in general shown, the test 
results to follow the predictions of 
a theory that has been useful. 

In addition, when there is agree- 
ment about what a construct means, 
some evidence about validity can 
come from an examination of the item 
content of a test. For example, 
most of us would probably agree that 
a test to see how many bricks a per- 
son can load on a truck in an hour 
is a poor test of verbal ability, 
and that a, list of multiple-choice - 
vocabulary items would provide a 
more valid measure of that con- * 
struct. (Similarly', the vocabulary 
test would be a poor test of endu- 
rance . ) .Therefore, deliberately 
including items to measure a given 
construct in itself can- provide some 
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limited degree of confidence in a 
scale's construct validity. 

The evidence is strengthened if 
the scale shows expected patterns of 
correlations, with other scales. And 
it is especially strengthened if- 
applicable experimental manipula- 
tions influence scores in predicted ^ 
ways. Other evidence of validity, 
can come from an examination of dif- 
ferences in scores on the scale 
among groups known or believed to , 
differ in the characteristic being 
measured. For widely used instru- 
ments, these kinds of evidence accu- 
mulate over time. Eventually, a 
basis for judgment about a scale's 
construct validity emerges — although 
different judges often disagree. 

Subsequent sections describe the 
origins, development, and some psy- 
chometric properties of a two-level 
set of assessments of schools and 
their inhabitants. These sections 
are intended to provide information 
about reliability and validity, and 
to describe f the normative interpre- 
tation o£ these assessments. 

Measures of Students 

Five sets of measures of indivi- 
dual students have been developed 
from discussions, with the staff of 
delinquency prevention projects 
about, the problems they faced and 
what they hoped to accomplish, the 
demands of evaluating a program with 
overarching goals of school organi- 
zational change and delinquency pre- 
vention, and the. theory & of delin- 
quency prevention. These measures 
of students are needed to assess 
project ef f ectiveness urtder diffi- 
cult f ield research conditio^ and 
to learn more about what works for. 
whom. 



Social Background \ 

Measures of social background or\ 
family 'characteristics are nee'ded \ 
for two reasons: (a) They provide \ 
essential statistical controls to 
aid in demonstrating project effec- 
tiveness when evaluation designs ' 4 
calling for statistical adjustments * 
are necessary* or when stronger 
designs fall apart. (b ) In a few 
cases, projects aim to d alter family 
characteristics — usual ly the extent 
to which parents value education and 
encourage their children to perform* f 
well in school. 

Accordingly, the following two 
measures were developed: ^ 

P arental Education . This two- 

f- 

item scale /is based on decades of 

research that show parental educa- 
tion to be a powerful antecedent of 
schooling outcomes, especially of 
persistence in education (Jewell, 
Waller, &'Portes, 1969a). The two 
items ask how much education a stu- 
dent's father and mother completed. 
Phe scale has a^ reliability coeffi- . 
cient of .78 overall, although, the 
coefficient for the small group of 
Native Americans in the sample is 
only .51.2 Table X displays the* 



2. Somewhat more detailed results 
of the examination of homogeneity 
coefficients for measures employed 
in the first year of this evaluation 
are presented in the first interim 
report; ; -Some improvements in the 
measures at$ reflected in results 
preaentedr-here. Homogeneity coef f ir 
ciencs reported here : were- calculated 
from a 10% sample .of : the whites, a 
•10% sample of Blacks ,/ a 10% sample 
for the combined groups, a 20%. sam- 
ple of mainland Hispanic youths, and 
a ,i00% sample of all other groups 
measured in the Spring of 198.2. 
Reliability coefficients are re-es-^ 
timated here because of a new scor- 
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. ' . Table 2 

Reliability Coefficients (Alpha) for Individual-Level Student Scales 
V ' ' by Gender 



Scale- 



Male 



Females 



Total 
Sample 



Number 
of items 



Family background 

Parental education I 
Parental emphasis on education 

Social relations 
. Attachment to parents 
Negative peer influence • 



76 
57 



61 
63- 



72 
51 



60 
67 



78 
50 



60 
65 



2 
4 



6 

.9 



"Artitrudes^atrd - soc±al"~development" 
Alienation 
Attachment to school 
Belief in rules 
Interpersonal competency 
Involvement" ' , 

Positive self -concept 
Practical knowledge 
Rebellious autonomy 
Internal coatrol 



60 
. 76 
52 
43 
60 
>58 
73 
49 
58 



44 

75. 

54 

47 

62 

60 

75' 

49 

56 



51 
76 
53 
4-2 
62 
61 
75 
47 
52 



6 
10 
6 

■5- 
12 
12 

7 

3 

7 



Behavior 

School ef f or t - ( = 

School non-attendance 

Self-reported delinquency (total) 

Self-reported drug use 
, Self-reported. serious delinquency 



62 

61.' 

84 

78 

77 



56 
62 
85 
77 
80 



59 
,.61 
85 
75 
83 



5 
2 

19 
5 

11 



School experiences 
School punishments 
School rewards 
Victimization 



54 
63 
58 



53 
58 
73 



54 
56 
69 



Validity 
Invalidity 



44 



45 



44 



Note: Decimals are omitted. 
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scale's hbmogenei^y/ estimates for 
six ethnic groups . ^ liable 2 displays 
the scale's reliability estimates 
for males and females ancl fo'r the 
t'otal (combined) sample. This meas- 
ure may be taken as an indicator of' 
family .socio-economic status. \ It is 
known to be a good pjr edict or of 
schooling outcomes such as persis- 
tence and grades (Bachman, Johnson, 
& O'Malley, 1978; Jencks, 1979,), but 
it is usually only weakly related to 
"34 1 in quen t 'b'eKavior " at the " iti d i V i^ 
dual level — although perhaps it has 
a stronger relation to more serious 
delinquency (Tittl^& Villimez, 
1978; Gottfred.son, 1981a). 

Parental Emphasis on Education . 
This four-item sc&Te asks for infor- 
mation about the degree of parental 
attention to the student's school • 
performance and parental expecta- 
tions' for school persistence. It 
was suggested by prevention project 
theories that attributed student 
non-attendance to a lack cf parental 
encouragement or "value" on educa- 
tion. And, parental influence is 
demonstrably predictive of student 
persistence in school (Otto, 1976). 
The scale is only moderately relia- 
ble — .50 overall, with homogeneity 
coefficients ranging from .45 to .57 
for race-sex subgroups. The scale 
has moderate negative correlations 
with ^self-reported delinquency (see 
Gottfredson et al., 1982, Table 4)V 
and has ah expected, but small, 
positive correlation with' student 
reports of effort 'spent on schtfol 
work. 



ing procedure implemented in year 
two to increase, the interpretability 
of the results, and because some 
measures (Alienation and . Internal 
Control) wejfe lengthened by adding 
new items. / 



Social Relations 1 

" T • / • 

Three -measures oft/a student's 
social relations were developed 
because of (a) empirical and theo- 
retical links between bonds of 5 t 
affection or respect for others and 
conforming (non-del inquent ) behav- 
ior', (b) powerful statistical asso- 
ciations between delinquent behavipr 
and' delinquent peer influence, 
(c) the central place given to peer 

inf luence-in— the— theories of several... 

of the prevention projects, and 
$ (d) the explicit assumption made by 
-^several projects th&t parental 
supervision governs student atten- 
dance . 

Attachment *to Parents . This 
scale, intended to measure Hirschi's 
construct of the same name, incorpo- 
rates several items closely related 
to items shown in earlier studies to 
be, correlated with delinquent behav- 
ior (Hirschi, 1969; Hindelang, Hir- 
schi, & Weis, 1981; D. Gpttfredson, 
1981b ).*% An attempt has been made to 
engineer a potent scale by including 
six items related to this construct. 
The scal^f, asking students bow close 
they are fo their parents, how much 
they like them, and so forth, has an 
overall reliability of .60. It^eor- 
relates as expected with self-re- 
ported delinquent behavior (see. 
Chapter 4 (this volume) and Gott- 
fredson, Ogawa, Rickert, & Gottfred- 
;jsj>nj: ; 1982), in accord with Hirs-chi's 
(1969) theory that at tachment ..to 
parents creates a stake in conform- 
ing behavior. This, agreement pro- 
vides some evidence of the construct 
validity of this scale. 

* I • ' . 
Negative Peer Influence . This 
scale measures a construct central 
|to the. explanations of delinquency 
jand non-attendance formulated* by 
iseveral of the action .projects. It 
.is 'rooted directly in e'arlier 
research (summarized by Empey, 1978) 
that shows delinquent peer* associa- 
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tions to bq powerful predjLctors of • ' 
dielinquent involvement. In addi- {i ; 
tiori, it incorporates items related 
to dropout , similar to those used in 
earlier studies of persistence in 
schooling (Bachman et al . , 1978). . 
It is au attempt to engineer a long, 
powerful-, and broads-based measure of 
negative peer influence. This 
nine-item scale has reliabilties^ 
ranging from .55 to .70 across sib- 
groups and, it is a potent correlate 
of delinquent behavior (Chapter/ 4, 
this volume; and Gottfredson, 1982). 
It contains items asking whether the 
student's best friend is interested 
in school, thinks getting good 
grade§ is 'important, thinks school 
is a pain, or has been involved in r 
delinquent activities. / i. 

Attitudes and Psychosocial Develop- 
ment. . ■/ 



Psychosocial development is a 
majoij goal of the Alterna/tlve Educa- 
tion Program. In this^area, there 
was considerable prior work to build 
on in choosing measures/ to include 
in the battery. ' . 

Alie nation * The. six-item Aliena- 

tl . 

tion Scale is based in part on 
Srole's (1956) Anoiaia Scale, but 
fewer items are included, and the 
wording of items ha's been changed to 
give them more school -related con- 
tent and to make fhem sound a little 
less bizarte^ Alienation items used 
in the School Initiative Evaluation 
(Grant et al . , 1979) and in other 
previous studies were modified for 
use here.. Items include, "These 
days I get the feeling that I'm just 
not a part of, things. 11 And, "I f^el 
no one really cares* much about, what 
happens to Trie." Overall, this short 
scale has a reliability of .51. 
(The reliability is improved over 
the 4-item version used in 1981.) 
As expected, the scale correlates 
positively with self-reported delin- 
quent behavior, and negatively with 
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reports of effort expended on school 
work (see Gottfredson et al . , 1982, - 
Table 4; and Chapter 4, this 
volume) . 

Attachment to School . This is a 
central construpt for many projects 
whose majoj: goal 6r objective is the 
' development of positive student 
/attitudes /toward school. The con- 
Is truct is^also central to social 

control theories of delinquency 
"(Hirschi, 1969) that view -attachment 
to school as a major social bond 
r es t r aining f X.OW- .part i- 
cipation in delinquent behavior. 
Consequently, we have constructed a 
relatively long and broad-based 
measure of attachment to school. 
This 10-item scale has reliabil ities 
ranging from .66 to .82 across sub- 
groups — .76 overall. -Items ask the. 
students if they like the school, ;if 
they like the classes, how" important 
g tting good grades is, and so 
f jrth. The* scale is, an expected, a 
powerful correlate of delinquent 
behavior (negative) and effort 
expended at schoolwork (positive) 
" (Gottfredson et al . , 1982). 

Belief . The expectation ^that 
individuals differ in the extent to ' 
which they believe in the moral val- 
idity of conventional social rules, 
and that the degree of belief influ- 
* ences behavior, is widely shared.. A 
common goal of peer-grpup-based 
interventions to prevent delinquency 
is to strengthen belief- by using 
peer pressure. The item content of 
Gough's (1964) Socialization scale 
(which was developed through empiri- 
cal ef fbrts to discriminate between 
adult offenders and non-offenders) 
lends support to this popular 
i notion. And, belief is a central 
0 construct in social control theory, 
which postulates .that people differ 
in the degree to which they have 
internalized rules, and t^at they 
therefore are constrained from 
involvement in delinquent behavior 
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to different degrees. Much 
empirical evidence supports this 
idea (e.g., D. Gottf redson', 1981b; 
Hirschi, 1969). 

Consequently, in order to measure 
this aspect of psychosocial develop- 
ment we have assembled a short scale 
from well-worn items used in other 
research, whose characteristics w>jre 
known. The six-item scale contains 
items such as, fit is all right ;o 
get around th^law if you can;" 
"Taking things "from stfores doesn't 
hurt anyone ;" and "People who leave 
things around deserve it if their 
things get taken." The scale has a 
reliability of .53 overall; its 
reliability is lower for the Span- 
ish-speaking and Spanish surnamed 
subsamples, and' higher for the other 
subsamples. The scale has a sub- 
stantial, negative correlation, with 
with delinquent behavior (Gottf red- 
son et al., 1982; Chapter 4, this 
volume), as earlier research and 
theory impl^ it should. 

Interpersonal Competency . This 
scale is composed of four items from 
Holland and Baird's (1968) Interper- 
sonal Competency Scale. It consis- 
tently has moderate reliability and 
correlates positively with other 
measures of psychological health 6r 
adjustment, and .negatively with 
measures of al ienation. The fifth 
item was written by Holland espe- 
cially for the present purpose, to 
give the scale more school-related 
content. It has a reliability coef- 
ficient overall of .42. This meas- 
ure correlates positively with 
reported effort expended on school 
work, and it is nearly independent 
(uncorrelated with) self-reported 
delinquent behavior (Gottf redson et 
al., 1?82). This accords with other 
evidence that delinquent involvement 
is only modestly associated with 
psychological health (Waldo & Din- 
itz, 1967; cf. Quay, 1964). 
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Involvement . This, scale' is 
intended to measure a central con- 
struct ^in social control theory that 
v does not appear to have been well 
measured in the past* The idea is) 
that involvement in conventional 
activities creates a stake in con- 
formity, because a person involved 
in rewarding activities has some- 
thing to lose, by misconduct. This 
scale (not to be confused with envi- 
ronmental measures of student "influ- 
ence or involvement in decis ion-mak- 
i rtg : ') i s " fcOmp 0 a e d of ' 1 2 it em s * (mo s t . 
of which were adapted from the 
recent National Longi tudinal Study 
questionnaire) asking about a stu- 
dent's participation in a wide vari- 
ety of in-school activities . It has 
an overall reliability of .62, but 
does not correlate as expected with 
reports of delinquent behavior, 
casting some doubt on its construct 
validity or on the -Utility of the 
involvement construct in theories of 
del inquency. Although this scale 
wps intended to serve as an impor- 
tant intermediary outcome measure, 
its utility is in doubt. 

Positive Self-Concept . A number 
of self-esteem scales with well-re- 
searched properties are available 
(Robinson & Shaver, 1973, review 
more than 30 measures). To create a 
short' scale, items previously used 
by Rosenberg (1965) and an item 
* similar to one used by Coopersmith 
(1967) were subjected to analysis 
along ^ith another set of items con- 
structed to capture aspects of 
self-concept specific to schooling 
and delinquency . This scale also* is 
based partly in the labelling per- 
spective (Lemmert, 1972), which 
Implies that if people are treated 
as slow learners or delinquents, 
they will come to incorporate 
aspects of those social definitions 
into their own self-concepts. Posi- 
tive self-concept , therefore , is an 
important intermediary outcome 
according to labelling theory. 
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According to this perspective,, 
effective alternative education 
projects would* increase scores on 
the positive self-concept scale, and 
a program with unexpected negative 
side-effects could decrease scores. 

Item analysis did not justify 
treating self-esteem as a separate 
scale from these labelling outcomes, 
betause items' are about equally cor- 
related across the two sets. Weak 
items were excluded, leaving a 
12— item scale wi<th reliabilities 
ranging from -.52 to .65 across sub- 
groups, .61 overal l . Items include , 
"My teachers think I am a" slow lear- 
ner ; 11 "Sometimes I thi,nk I am no 
gQod at all;" "I am the kind of per- 
son who will always be able to make 
it if I try;" and "I do not mind 
steeling from someone — that is just 
the kind of person I am. 11 The scale 
correlates .48 with reported effort 
on school work, and -.24 with self- 
reported delinquency , and it corre- 
lates -.39 with al ienation* and .39 
with interpetsonal competency (Gott- 
fredson et al., 1982), lending sup- 
port to its construct validity. 

Practical Knowledge , To provide 
a simple measure of self-reported 
Competencies'needed for coping with 
everyday life, a seven-item measure 
was created for the evaluation. 
Although this' self-report scale may- 
be a poor substitute for a more com- 
prehensive or task sample approach, 
it seemed the only way to build a 
measure of this kind of social 
development into a multi-purpose 
battery. The scale has a reliabil-. 
ity coefficient of .75' overall, and 
good item properties across all ^ 
groups studied. Tr is relatively 
independent of the other measures.of 
attitudes and behavior. "Because it 
has not been well-studied, it should 
be interpreted cautiously. 

Rebellious Autonomy . In talking 
with persons running the delinquency 
prevention projects, especially the 



Meofiureo 

Peer Culture Development Project in 
Chicago, 4 explanations of the problem 
of delinquency sometimes involved a 
kind of peer or . gang culture thtft 
resembles Miller's (1958) character- 
ization of subcultural socializa- 
tion. The peer or gang culture may 
incorporate a set of socially-shared 
expectations that are different from 
what might be called middle-class 
expectations. Differences may be so 
great that in behaving according to 
the "lower-class" system a person 
may violate norms of middle-class 
culture, ar^4 nia^ appear tfe? be deli- 
berately non-conforming or malicious 
to a "middle-class" observer. In 
particular, middle class concerns 
with achievement may not be shared 
by "lower class" youth (cf. Attach- 
ment to School and Educational 
Expectations). Instead , these "low- 
er-class" youths, according to 
Miller are concerned with trouble, 
toughness , smartness (i.e., manipu- 
lative skill), excitement, fate 
(explaining events by reference t0 
change or luck), and autonomy (an 
ambivalent relatio'n^to author- 
ity — overtly desiring not to be 
pushed around but covertly desiring- 
to be cared fpr and controlled). 

Because of this recurrent theme 
in our discussions with action proj- 
ect personnel, it seemed important 
to incorporate brief measures of 
this type of "subcultural" value 
system. Item analyses of a larger 
set of items implied that three of 
these items formed a scale for all 
race-sex subgroups. The deletion of 
poor '-items, however, narrowed the n 
content of the set down to items 
that appear* to reflect a rebellious 
.autonomy: "Whether or not I spend 
time on homework is my own busi-. 
ness;" "I should hot* have to explain 
tcr anyone how I spend my money;" and 
"I don't like anybody telling me 
what to do.", The scale has a reli- 
ability of .47 overall. The scale 
correlates as expected with Delin- 
quent * Behavior and Belief 
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(Cottfredson ut al . , 1982; Chapter 
A, this volume). 

Internal Cpntro 1 . A number of 
the prevention projects view delin- 
quent behavior as a result of weak 
internal controls, that is -of a por- 
tion's sense' of powor 1 esaness over 
the environment- If what one does 
makes little difference for the 
rewards , puni shnujnts , or achieve- 
ments one experiences, then one is 
free to engage in unrestrained, 
self-gratifying delinquent behavior. 
These speculations appeared to us to 
be related- to Rotter's (1966) 
notions of internal and external 
control. Accordingly, we attempted 
to include a small number t of items 
related to this construct in surveys 
conducted in the first year of the 
evaluation. Item analyses did not 
support the utility of -a scale based 
on those items, and renewed attempts 
to develop a suitable measure were 
made in the second year. The scale 
that finally emerged has an overall 
reliability coefficient of f52, and 
works reasonably well for each race 
and sex Subgroup. A sample item is, 
"Much of what happens to me is just 
a matter of chance." 

Self-Reported Behavior 

At bottom, it is the behavior of 
the young people subject to the 
influence of the Alternative Educa- 
tion Program that is important. 
The measurement of behavior is 
therefore essential to the evalua- 
tion. One source of information 
about the behavior of individuals is 
the archival records that are .main- 
tained in various ways by schools 
and criminal justice agencies. 
Those archival records are, however, 
subject to inAgy limitation^: They 
vary in completeness , 'accuracy , and 
* availability. Different behaviors 
are recorded in different places, 
and they are recorded in different, 
ways. And, official records measure 
ndt only the behavior of the people 



who are their aubjoct , but also the 
behavior of school and justice sys- 
tem officials who make decisions 
about what to record. 
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Accordingly , to provide for the 
systematic measurement of behavior 
in parallel ways for all of the pre- 
vention projects, we have developed 
several self -r eport measures. These 
, self-reports are also subject to 
limitations, but they do make rapid 
analysis possible, they are parallel 
across all projects, and .previous 
research generally, supports their 
use (Hindelang et al . , 1981 ). 

:hool Effort . That students Who 
eafrn low grades in school tend to 
frop out of school and to engage in 
"delinquent behavior more than others 
are two of the best documented and 
consistent findings < ill the litera- 
ture (D. Gottfredson, 1981). Social 
class and ability are modestly asso- 
ciated with these same outcomes but 
do not completely account for these 
associations. Therefore , it seems 
likely that these outcomes are det- 
ermined at least in part by grades — 
the'major, if infrequently applied, t 
reward system of traditional school- 
ing. Grades in school are not det- 
ermined solely by ability and social 
class, of course. Industrial psy- 
chology's instrumentality theory 
(Porter & Lawler, 1968) suggests a 
mechanism whereby effort is expended 
if valued rewards are perceived as 
attainable, and in which effort is' 
one of the determinants of « both per- 
formance, and rewards. Therefore 
effort is an important intermediary 
outcome variable that should be 
assessed in the evaluation of a pro- 
gram designed to prevent delinquency 
and foster persistence in< schooling. 

Unable tp locate existing quesr 
tionnaire measures of this con- 
struct, we v developed one. This 
ISive- it em scale has a 'reliability of 
.59 overall. (It is somewhat less^ 
reliable foV Puertc^J^ican subsample, 
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priMUimably because Borne of itfl item 
content deals with homework, which 

, i8 rarely unsigned in Puerto Rico.) 
The. scale include*! these items:' 
"Compared to other ntudents, how 
hard do you work in school?"; "I 
turn my homework in on time"; and M I 
don't bother with homework or class , 
assignments . " Aa expected , female a 
Hc>fe higher on thia Bcnle on the 
average than do males. It corre-, 

. latea, >^9 with self-reported grades 
and .34 with attachment to school 
(Gottf redsoni et al., 1982), sup- 

. porting its interpretation as a 
measure of effort expended on school 
work. 

School Non-At tendance . The 
Alternative Education Program is 
intended to demonstrate and evaluate 
projedts that aim to increase 'atten- 
dance. Dependable attendance data 
are not always available from school 
records, so a brief self-rfcport 
measure of attendance was incorpo- 
rated in the questionnaire to pro- 
vide back-up data. This dedi^ipn 
proved to be' wise. Attendance data 
from school records proved erratic, 
incomplete, error-ridden, and slow 
in coming., 

Two items, one asking how often 

the student cuts school all day and 
one asking about clas^ skipping, % 
compose this brief scale, with an 
Coverall reliability of .61. 

Self-Reported Delinquency 
(Total) . One'way to'find out What 
people do 'is to ask them. Natu- 
rally, not everyone tells the truth, 
perhaps especially when the ques- 
tions ate sensitive. A common 
assumption is^ that people will con- 
ceal information about theit parti- 
cipation in illegal behavior » and so 
under-teport . At. the same time, the 
rates of delinquent behavior esti- 
mated by the self-report method are' 
higher than those derived from offi- 
cial records (Empe? & Erikson, 



1966). There in thus a*-'great deal 
of dejbate anions criminologists ability 
t lip. Appropriate* way to measure cr'imr 
inal behavior. 

Although' there is no need to go 
into the' arguments in any detail 
here, a major issue is that typical - 
s elf -re port measures (e.g. ( , Nye , 
1958) tend to measure minor 
"of f enseo , M some of which are not 
"crimes," or would not be crimes 'if 
committed by an adult. Elliot and 

* Ageton (1980) have recently pre- ^ 
sented evidence that self-report . 

• scales involving more serious 

• / offenses tend to resemble measures' 

based on official data more than do I 
scales involving only trivial items*. 
Hindelang, Hirschi, and Weis (1*981) 
have recently published a disquisij ' 
tion on the measurement of delin- 
quency by self-report and official 
measures. * 

j The bottom l4.ne , insofar as it; 
can be perceived at present, is that 
f airly long , variety- type scales 
invoLving a range* of serious delin- 
quent behavior do produce results 
that parallel official records for 
-* some subgroups but not for others. 
Hindelang, et al. (1981) report val- . 
idity coefficients for a number of , 
alternative measures that .imply very 
lew validity of self-reported data 
for of ficialUy' "delinquent" black 
males, and much better validity - for 
other subgroups. This is a 'diffi- 
culty that should be kept in mind in 
interpreting these se lf-repQr ted 
data. 5 * . ; 



3. This difficulty appears xelated 
to a similar problem .of differential 
reliability in studies of educa- 
tional persistence (Bielby, Hauser, 
& Featherman, 1977; D. Gottfredson, • 
1981a), and this potential problem • 
increases the importance of obtairi- * 
ing bffitial data for purposes of 
evaluation. The 'differential Valiifr* 
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The specific self-report measures 
used here are modified from those 
/used by Elliot and Ageton (1980) and 
by Hindelang, Hirschi/, and Weis \\ 
(1981). Many of Elliot's items fere 
used, but a "last-year variety" 
scale format was used because the 
Hindelang et'al. (1981) results sug- 
gested the usefulness of this for- 
mat". These items, ask, "In the last 
. year have^you..." Respondents indi- 
. cate, for iexample, whether they have 
& "stolen or tried to steal something 
vrorth more than $50." 

r 

A 19-item scale constructed in 
this way has very nice character is- 
°* tics--considering^.that only a small 
-proportion of respondents answer yes 
to any given question. Overall, 
reliability is .85. The (subgroup 
reliabilities range from U 8 3 to 
.88. 4 

Self-Reported Drug Involvement . t 
Prevention project personnel have 
shown considerable interest in a 
c component' of delinquent behavior 
' - involving drug use. To provide a 
'measure to "ineet their needs, we have 
also Scored a five-item subset of 
the longer (total) S-R' delinquency 
scale. l It is composed of items ask- 
ing about the, use of cigarettes, 
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-i^f^Tfproblem is discussed in Part II 
of tlve present r&port (Daniels & 
GotfcfTedson, 1983) but is not 
resolved. 

4.* 'In our first interim report we 
estimated reliabilities for more 
narrowly defied subgroups • The' 
single lowest coefficient was for, 
' Asian-American females , who report 
alpiost no delinquent behavior. The 
reliability for that group vas .63. 
These reliabilities compare favora- 
bly to those obtained by HindeLa^g 
et al. (1981) with a 63-item last- 
year variety scale--. 83 to .92 for 
black and white males and females. 



liquor, marijuana, and other drugs, 
and about going to school "high." 
(A sixth item about glue sniffing 
was left out because the analyses 
did not support its inclusion for 
all ethnic groups.) This group of 
items closely resembles the Hinde- 
lang et al. (1981) Drug Index. It 
has an overall reliability of .75. 

Self-Reported Serious Delin - 
quency . A second subscale was con- 
structed to measure only conduct 
that nearly everyone would) rega'rd as 
criminal. It includes 11 items . 
[including one about selli^j^ drugs 
/that^Hindelang et al . would place in 
the drug cluster) and has an overall 
reliability of .83. 

Measu res of School Experiences 

It is anticipated that the proj- 
ects in the Alternative Education 
Program will^xpand the range of 
school rewards beyond those repre- 
sented by traditional classroom 
grades. Accordingly, in an effort 
to assess this important but hard- 
to-measure set of outcomes, we have 
developed two scales to measure'stu- 
dents' rewarding and punishing 
experiences". School regards and 
punishments make sense intuitively 
as probable causes of school attach- 
ment ef for t , and persistence. 

One kind of school experience is 
of* special importance: victimiza- 
tion. A .key measure of the success 
of the delinquency prevention proj- 
ects under study is the level of 
personal victimization experienced 
by persons in* those schools. 
Accordingly, victimization experi- 
ences must be measured to assess the 
effectiveness of the projects, and 
to learn more about the victimiza- 
tion experience itself. 

School Punishments . This four- 
item scale is. an index of the nega- 
tive sanctions an individual student 



-28- 



41 



Measures 



experiences. It a«ks whether the 
student was required to stay aft*er 
school, given an extra assignment, 
or had his or her grade lowered as a 
punishment. Its reliability coeffi- 
cient for the total sample is .54. 
According to this index males exper- 
ience more punishment, as expected, 
and the scale correlates .30 with * 
sel f -repor ted de 1 inquency , - . 28 wi th 
positive self-concept, -.30 with 
belief, -.22 with school effort, and 
.24 with negative peer influence 
(Gottfredson et al . , 1982). 

School Rewards . This six-item 
scale is an index of the positive 
sanctions an individual student 
experiences. It includes reports of 
incidents in which the teacl^ey com- 
plimented the student's work, the 
student was given a prize or award, 
or the student won an award for his 
or her class. The reliability coef- 
ficient for the entire sample is 
.56.. The scale is relatively inde- 
pendent of sex, and is correlated 
.25 with school attathment (Gott- 
fredson et al .., 1982) . 

Victimizat ion . A final measure 
of school experiences deals with 
personal victimization. It is 
intended for use in assessing the 
amount of \crime in the environment, 
and it is used in the aggregate to 
characterize the school. The Vic- 
timization Scale is also intended 
for use in research on the victimi- 
zation experience. The scale's 
characteristics at the individual 
level are therefore of interest. 
Containing five items, the scale has 
a reliability coefficient of .69. 
Victimization is correlated .24 with 
self-reported del inquency , implying 
a moderate tendency" for persons who 
are victimized to engage more in 
delinquent behavior themselves; It 
correlates -.27 with school attach- 
ment and -.£8 with self-esteem; its 
highest correlate among the varia- 
bles examined is punishment 



(.35) — students who report more 
frequent personal victimization also 
more often report being punished^in 
school (Gottfredson et> al . , 1982>. 

Quality Control 

There iValways some concern that 
students may not faithfully complete 
their questionnaires, that they may 
fool around or give silly answers. 
\As a check on this, a scale was 
\included to detect unusual pr" non- 
sensical responses. 

\ Invalidity . This five-item scale 
is composed of items that a cateful 
respondent would answer t in only one 
way. A is keyed so that <a rare 
response earns a point. This 'scale 
is used as a check on the results 
and as a quality control mechanism. 
Invalidity scales are intended not 
to measure a reliable characteristic 
of individuals and hence usually 
have low reliabilities. The overall 
reliability of this scale is, .44. 

Stability of Student Measures Over 
Time 

One-year re-test reliabilities of 
each of the measures of student 
characteristics described above are 
presented in Table 3. These stabil- 
ity coefficients provide information 
about the degree to which young peo- 
ple tend to retain their relative 
standing on these measures from year 
to year. 

Re-test reliabilities for several 
measures not already "described are 
also presented in Table 3. These 
personal characteristics were meas- 
ured using single items (so it is 
not possible to calculate homogene- 
ity coef f icients . They are 
described in the following list. 

f 

Educational Expectation . An item 
asked students how far in school 
they expected to gq/. The response, 
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One-Year Retest Reliabilities of Student Characteristics 



Males 



females 



Student character is tic 



r 


N 


r 


N 


XX 


XX 




.70 


546 • 


.72 


626 


.34 


373 


.39 


471 


.38 


879 


. .47 


1007 


.44 


849 - 


.39 


1007 


.33 


674 


.39 


870 


.53 


791 


.46 


975 


.38 


662 


.40 


888 


.32 


602 


.32 


810 


.37 


747 


.50 


888 


.45 


576 


.50 


798 


.36 


669 


.43 


893 


.37 


552 


.40 


766 


.48 


959 


.41 


1081 


.46 


851 


.40 


966 


.42 


.969 


.45 


1081 


.63 


419 


.55 


584 


.66 


416 


.60 


583 


.46 


390 


.30 


563, 


.27 


805 


.32 


. 979 


.33 


804 


.32 


982 


.35 


788 - 


.23 


961 


.41 


991 


.52 


1085 


.32 * 


677 


.31 


396 



Family background 
Parental Education 
Parental Emphas is on 



Education 



Social relations^ 
.Attachment to Parents 
Negative Peer Influence 

Attitudes and psychosocial developme 
Alienation 3 
Attachment to School 
Belief in Rules 
Interpersonal Competency 
Involvement 
Posit ive Self-Concept 
Practical Knowledge 
Rebellious Autonomy 
Educational Expectation 

Behavior 

School Effort . 
School Non-Attehdance 
Self-Reported Delinquency (total) 
Self-Reported Substance Use 
Self-Reported Serious Delinquency 

School experiences 
School, Punishments 
School Rewards 
Victimization 
Self-reported Grades 

Validity indicator 
Invalidity 



Note, Reliabilities calculated on a random half sample* of students 
who completed questionnaires in both 1981 and 1982. 

a An improved Alienation Scale was available in 1982. The correla- 
tion reported is the correlation between this improved measure and 
a less reliable measure used in 1981. 
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Reliability Coefficients 'for the Individual-Level 
Teacher Scales, Number of Items in Each Scale, and 
Scale Means and Standard Deviations 



/ 

/ 

Scaie / 

/ / ■ 


N 6f 
Alpha items 


Mean 


SD 


/ ' / 

/Pro integration Attitude 

/ * f 




1 

4! 


11.56 


2.88 


Job Satisfaction 


' .80 


1 

3 

i 


8.42/ 


1.70 


Interaction with Students 


.67 


1 . 
6 

| 


13.79 


4.20 


Type A Sanctions 


.47 


5 ' 


.09 


2.82 


Type B Sanctions 


.60 


j5 


13.42 


3.08 


Victimization 


.67 ' 


|8 


1'.23 


1.45 


Classroom Disruption 


.78 


! 2 


4.60 


1.38 

iff . 


Low Expectations' 


.57 


2 


65.06 '\ 


44.47 


Professional Development 


.74 


8 


-.39 (, 


4.67 


, Nonauthor itar ian Attitude 1 


.54 


3 


7.43 


2.17 



Note ., 'Reliabilities and scale means and Sp's are based on 
results from the 198d Spring administration of these scales and 
are calculated on the "holdout" sample (see Gottf redson' et al., 
1982). N's range ^from 555 to 643 due to item nonresponse. 
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which is intended to provide an , 
indicator of commitment to, a conven- 
tional goal, has a re-test reliabil- 
ity of .48 for males and .41 for 
females. Educational expectations 
generally have substantial negative 
correlations with delinquent behav- 
ior (D. Gottfredson, 1981). The 
correlation in a random half of the 
1982 survey data between this item 
and Self-Reported Delinquent Behav- „ 
ior was -.12 (p < .001) for' boys and 
-.08 (p < .01) for girls. ^ 

Self-reported Grades . We antici- 
pated the potential necessity of 
having a questionnaire-based measure 
of school performance to supplement 
data collected from sctiool rectprds . 
Accordingly, a self-report of school 
grades was included in the question- 
naire. This item has a re-test 
reliability of .41 for boys and .52 
for girls. 

T Mp aRiires of Teachers 

* — — ■ i 

The second largest group of inha- 
bitants of a school environment are 
the tisachers who -work . there . Stu- 
dents in the aggregate help*' to 
create an environment for the teach- 
ers, just as teachers create an 
environment for the students. A 
characterization of the teachers is 
therefore important in describing a 
school. 

Several, of the action projects' 
theories lead to interventions 
geared toward teachers. The inter- 
ventions are intended to improve 
classroom management, to change 
teachers' attitudes, or to involve 
them in new kinds of activities. l» 
One aspect of the evaluation there- 
fore involves the measurement of 
teacher characteristics. 

Pro^Integration Attitude . This 
four-item scale is a measure of 
attitudes toward integrated educa- 
tion. It is included because these 
delinquency and schtfol -improvement " 



programs are designed to provide " 
services to heterogeneous groups of 
students. , One component of several 
•projects is training teachers to 
manage heterogeneous classrooms an.d 
to interact with a variety of ki^ds 
of students. It has a . rel iability 
coefficient of .69 (Table 4) and is 
relatively independent of the other 
teacher scales (see Gottfredson et 
al., 1982). As might be expected, 
npnwhites tend to score somewhaj 
higher than whites, on this scale. 

Job Satisfaction . This scale* is 
composed of three of the four items, 
in Hoppock's (1935) scale of the 
same name, which has been used 
widely in research. Even shortened 
to three items it has a reliability 
of .80. It may confidently be taken 
as a measure of how well teachers 
like their jobs. 

Interaction with Students . This 
six-item scale measures the extent 
of out*-of*-cla8 8 interaction that a 
teacher has with students. Items 
ask about tutoring individual stu- 
dents before or after school and 
discussing their personal problems 
with them. It has a reliability 
coefficient of .67, and correlates 
positively with Job Satisfaction, 
negatively with reports of classroom 
disruption, and positively with the 
extent of recent continuing educar 
tion activities. 

Type A Sanctions . This is one of 
two scales developed in an attempt 
to describe the types of responses 
to student* conduct used by the 
classroom teacher. We aire unaware 
of « any short questionnaire measures 
of* this aspect of classroom manage- 
ment, but provocative evidience from 
earlier research (McPartland & 
McDill, f977; Gottfredson , & Daiger, 
1979) suggests that responses to 
conduct are important in preventing 
disruption. Therefore we used the 
test advice we could get to -develop 
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lists of various ways classroom 
teachers might respond 'to student 
behavior. These lists became items 
in the questionnaire. Through fac- 
tor analytic examination and inter- 
nal consistency item analysis, two ' 
scales emerged. , % 

The first set of items is" termed 
"Type A 11 Sanctions. A teacher who 
reports lowering grades as a punish- 
ment, sending misbehaving- students 
out of class, and paddling or repri- ,J 
manding the students in class is 
given a high score. - The scale has a 
reliability of .47. Its largest 
correlate among the other teacher 
measures is the amount of disruption 
the teacher reports; it is also mod- 
erately negatively correlated with 
nonauthor itarian attitudes. " 

Type B Sanct ions . This scale was 
developed in the same way. »In con- 
trast to the Type A scale, which 
seems to include responses * rooted in 
frustration, Type B Sanctions appear 
to involve a wider range of 
resources. To earn a high score on 
this scale, a teacher reports giving 
extra schoolwork, awarding special 
privileges for good behavior, taking 
away privileges for misconduct > 
calling parents, and referring stu- 
dents to the counselor or elsewhere. 
This five-item scale has a Reliabil- 
ity of .60. It correlates qply .16 
with Type A Sanctions, eyen though 
both scales would be elevated if a 
teacher frequently had to make some 
kind of response to misconduct . 
Gottfredson et al. (1982) examined 
the construct validity of the two 
sanctions scales by examining their 
correlations with responses to a 
question about home-based reinfor- 
cers. % The use of hom^-based rein- 
forcers to extend the range of 
rewards and punishments in the 
scjiool appears to be a highly effec- 
tive strategy (Barth, 1979; Atkeson 
& Forehand, 1979). Scores on the 
Type B scale correlated .35 with 
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responses to this item, whereas 
those on Type A correlate only .07 
(n.s. ) . 

Victimization . As one way to 
measure the amount of. delinquent 
behavior in a school, teachers are 
asked about their experiences of 
personal victimization. In the 
laggregate, these reports may be 
/taken as an indicator of the amount 
of disorder in the school. An 
eight-item scale, asking about 
events ranging from obscene remarks 
or gestures to physical attack, has 
a reliability of .67. 

» • ¥ 

Classroom Disruption . A second 
way to as sess the level of student 
misbehavior experienced by a.'*°acher 
is provided by a two- item classroom 
disruption scale. It asks to what 
degree clas sroom disruption inter- 
" f eTes with teaching, and how much of^ 
the teacher's time is devoted to 
coping with* disruptive students. 
Its reliability is .78.. 

Low Expectations « A labelling 
theory perspective implies 
that teacher expectations 
for student performance may 
become incorporated into the stu- 
dent's self-$oficept' and result in 
' misconduct or poor academic perfor- 
mance. To* provide a Aeasure of this 
variable, a two-item Low Expecta- 
tions Scale asks, teachers to judge 
what percentage of their students 
are of low ability $nd have "behav- 
ior problems;" The scale has a 
reliability of .57. It correlates 
-.24 with Job Satisfaction and .43 
with Cla'ssroom Disruption. 

Professional Development . Eight 
items form a scale measuring the 
extensiveness of recent continuing 
education or in-service learning. 
This scale, with reliability .74, is 
for use in documenting th6 implemen- 
tation of training components*. It 
also helps to lend evidence of con- 
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struct validity to othet teacher 
measures. Correlations reported by 
Gottfredson et al. (1982) suggest 
the interpretation that teachers 
scoring high in professional devel- 
opment ate more satisfied, # interac£ 
more with students, and are more" 
open to student suggestions. 

Non-Authlritarian Attitudes . 
Intended in part to measure sympath- 
etic attitudes (as one way to get at 
the "caring, competent teacher 11 con- 
stellation), a measure of punitive 
moralism is included. To earn a 
high scor^ on this . scale , a teacher- 
rejects such #items as, "A few pupils 
are just young* hoodlums and should 
be treated accordingly." This 
three-item scale has a reliability 
of .54. 

Stability of the Teacher Measures 

We were not permitted to identify 
teacher questionnaires, and there- 
fore cannot report on the stability 
over time of the individual-level 
teacher measures. 

Measures of School Climate 



climates using averaged 
characteristics of individuals (cf . 
Astin & Holland, 1961). Composi- 
tional climate scales are reported 
for information about the students 
and the teachers who inhabit 
schools.' In general, this type of 
climate scale describes the people 
who inhabit the schools. 

, Psychosocial climate scales . An 
alternative, and for some purposes 
more useful way, to characterize 
environments is to regard the inha- 
bitants—teachers and students — as 
informants about the environment. 
To construct this kind of climate 
measure reports about the environ - . 
ment (rather than about the 'indivi- 
duals who inhabit it)^ -aie used. For 
psychosocial cl imate scales , reports 
are first averaged, and then item 
analyses proceed based on school 
means for the it;ems. 

Measures of Psychosocial Climate 
Based on Student Reports 

*•» 

Community Crime . ..This is a , 
three-item scalp based on average d 
responses to questions about whether 
there are gangs in the student's 
neighborhood, whether the gangs try. 
to get 'the student to join and 
whether the student's parents were 
robbed in. the last year. This scale 
may be useful in describing thfe com- 
munity context of the school (cf. 
National Institute of Education, 
1978). It has a homogeneity coeffi- 
cient of .59 estimated from the 1982, 
data (Table 5). . ' ' 

Gangs in^School * This scale is 
composed of averaged responses to 
questions about whether there are 
gangs in the school and, if so, hoy 
much trouble they cause. The reli- 
ability (homogeneity) of this scale 
is .80* . 

Safety . This is a 13-item scale 

.^asking .if students stay away from 

< • 



The assessment of school climates 
is fundamentally different from the 
measurement of individuals. Whereas 
individual differences are the 
entire point of measurement at the 
individual level, these differences 
are "error" or "noise" in the 
assessment* of an environment based 
on the reports of its individual 
inhabitants. 

Compositional and Psychosocial Cli - 
mate Scales 

Compositional climate « Environ- 
ments are sometimes characterized by 
aggregated or averaged characteris- 
tics of' individuals . We have con*- 
structed compositional climate 
scales based on such aggregated per- 
sonal characteristics to descri^t 



Table 5 / 

Reliability Coefficients for the Psychosocial Scales 
Based on Student Report and Number of Items in Each Scale 



1981 1982 One-yr. N of 
Scale Alpha Alpha retest Items 



Community Crime 


S7 
■ j t 

< 




.91 


3 


Gangs in School 


* 

.80 


on * 
.80 


.82 


o 
Z 


Safety 


.92 


.94 


.83 


13 


Individualized Instruction 


.58 


.42 


.80 


2 


Disrespect for Students 


.78 


.85 


.83 


3 


Student-Teacher Interaction 


.60 


.64 


.79 


2. 


Planning and Action 


^65 


.84 


.82 


3 


Fairness 


.62 


.76 


.76 


3 


Clarity 


.64 " 


.67 


.70 


. 4 


Student Influence 


.62 


.74 


.84 ' 


6 


Grouping * 


.55 


.41 


.70 


3 



' Note . Alpha reliabilities for 1981 are generally bdsed on a 
smaller number of schools than those in 1982, which include all 
schools in the Initiative except those from St. Paul. We assume 
retest reliabilities are sometimes higher than the alpha coeffi- 
cients because psychosocial climate scales are based on school- 
level item means which are themselves very reliable and items are 
not strictly parallel as assumed by classical true score theory. 
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interaction with teachers, from the 
students' point of view. It is 
based on the averaged responses to 
two items: "I talk to some of my 
teachers about things other, than 
schoolwork; 11 and, "Teachers help me 
with schoolwork outside of class," 
Its homogeneity coefficient is .64. 



any of a list .of places in the 
school. It also asks if students 
feel safe at school, or if they fear 
someone will hurt them at school or 
on the way to school. It resembles 
what was called "School Climate 11 in 
the Schools Initiative 1 . Evaluation 
(Grant et al., 1979). Its reliabil- 
ity coefficient is .94. 

Individu al i zed I nstruct ion . This 
scale is an attempt to use student 
reports as evidence about the level 
of individualized instruction char- 
acterizing the school as a whole. 
Individualized instruction, as usu- 
ally construed, involves the devel- 
opment of individual learning plans, 
rewards for improvement over past , 
levels of performance, and a pace of 
instruction suited to th£ indivi- 
dual. Two aspects of this concep- . 
tion are incorporated in this meas- 
ure — students' reports that they 
have individual learning plans, and 
reports that they can work at their 
own speed in class. The homogeneity 
coefficient is .42. m 

Disrespect for Students . One 
theoretical perspective (Greenberg, 
1977) assumes that delinquency is in 
part a result of a special status 
accorded youth, one which isolates 
them from meaningful adult roles and 
subjects them to degrading interper- 
sonal exchanges to which adults 
would not be subjected. This scale 
is intended to assess the degree to 
which students feel that a school^ 
environment- as a whole either 
degrades them or treats them with 
dignity. A low score could indicate 
that .students feel ,they are treated 
with dignity'. Items include, "Stu- 
dents are treated like children 
hereT^^^i^ejrchers treat students with 
respect; 11 and "Teachers do things to 
make students feel put down." .Its 
reliability coefficient is .85. 

Student-Teacher Interaction . 
This scale aims to assess the degree 
of out-of~class -positive social 



Plannin g and Action . This scale , 
is intended to assess, from the 
point of view of the students, the 
degree to which schools engage in 
experimenting and problem-solving, 
or the degree to which they resist 
. change. It is composed of the fol- 
lowing three aggregated items: 'It 
is hard to change the way things are 
done in this school"; "The teachers 
and principal in this school make 
plans to solve problems 11 ; and This 
school hardly ever tries anything 
a^w." It has a homogeneity coeffi- 
cient of .84. 

Fairness.. Evidence is accumulat- 
ing that the degree to which stu- 
' - dents perceive a school's rules as 
fair and clear is associated with 
the degree of "orderliness of the 
school (National Institute , of Educa- 
tion, 1978; Gottfredson & Daiger, 
1979). Con sequeritly, scales 
designed to assess these constructs 
were developed. Fairness is a 
three-item aggregate-level scale 
-based -on student reports that the 
rules are fair, that the punishment 
for breaking rules is the same for 
everyone, and that the principal is, 
fair. It has a reliability of .76. 

'Clarity . .Intended to measure thi 
clarity of school rules from the. 
point of view of ttie school's stu- 4 
dents i this scale is composed of 
questions asking whether everyone 
knows what the, rules are, whether 
teachers l e t the students know what 
is expected, whether the principal 
is firm. This four-item scale has 
reliability coefficient of -67. 

• / . 
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Table 6 

Reliabilities of School Psychosocial Climate Scales 
Based on Teacher Report and Number of Items in Each Scaile 





1 QQ1 


\ 

1 QR9 


une~yr • 


in or * 


bcale \ 


Alpha 


Alpha 


retest 


Items 


< \ 

Involvement of Parents jand, 


.80 


.81 


.77 


'6 


Community \ 










Individualized ' Instruction 


.60 


.36 


.70 


4 * 


and Grading V 










Resources for Instruction 


.86 


.81 


,8i 


4 


Integration vs. Segregation by 


.55 


.59 


.82 


6 


Ability or Conduct^ 










School Race Relations 


.77. 


.74 


.53 


2 


Teaching Staff Commitment 


.82 


.91 


.73 


2 


tJse of Grades as a Sanction 


.84 


.65 


.56 


2 


Staff Morale (vs. alienation) 


.90 


.94 


.84 


11 


Planning and Action 


,&7 


.89 


.84 


10 


Student Influence 


,81 


.85 


.83 


5 1 ' 


Smooth Administration 


.92 


.93 


,80 


12 


Safety 3 




.94 • 


.75 


10 



Noti . Number of schools ranges from 48 to 50 schools for ,1981 and 
ranges froni 47 to 49 for 1982. An 'outlier school was deleted in 
the 1981 analyses, and all schools with fewer than 10 teachers 
were deleted in the 1982 analyses. N's for the re-test reliabil- 
ities i^ange from 33 to 37 \sehools. We assume; retest reliabili- 
ties are sometimes higher than the alpha coefficients because . 
psychosocial climate scales are based on schools-level item means 
which" are themselves very reliable and items are not strictly 
parallel as assumed by classical true score theory. 

a 

Reliability not calculated in 1981. Two litems relating to 
^classroom disruption included in* this scale in 1981 were deleted * 
in 1982, and in results presented for -1981 in this report the 
1981 scale is re-scored to correspond with the 1982 scores. 
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Student Influence , It is often 
assumed that student influence on 
the way a school is run may lead to 
a number of positive outcomes, and 
an increase in student participation 
in planning and decision making is 
sought* by OJJDP in the Alternative 
Education initiative. This six-item 
scale is intended to assess how much 
influence students have in their 
schools. Sample items include: 
"Students have little say in-how the 
school is run"; "Students have 
helped to make the school rules 11 ; 
and "Students ar'e seldom asked to 
help solve a problem the school is 
having." The scale's homqgeheity 
coefficient of .74. 

Grouping . This scale assesses 
the students' perceptions of group- 
ing, or segregation of students with 
special characteristics within the 
school. It is composed of the fol- 
lowing three items:- "Students of 
different races usually end up in 
different classes"; and, "This 
school has special classes for slow 
learners"; and, "There are special 
classes for trouble makers." It has 
2 homogeneity coefficient of only 
.41. 



Climate Scales Based. on Teacher 
Reports 

An alternative perspective t>n the 
climate of a school is provided by 
the reports of teachers. Accord- 
ingly, 11 climate scales were con- 
structed from the teacher question- 
naires using averaged teacher 
responses about their school^ Their 
names and reliabilities are shown in^ 
Table 6 . U 

Involvement of Parents and Commu - 
nity . A goaT of, the Alternative 
Education! Program is. to, increase the 
use of community and family 
resources by schools as a -structural 
school improvement. Th-is scale 



seeks to assess parent and community 
involvement according to aggregate 
teacher reports. It asks about 
parent influence on policies or 
practices , direct parent assistance , 
relations between parents and teach- 
ers, and community receptiveness'. 
The six-item scale has a homogeneity 
coef f icient of .81 . 

Individualized Instruction and 
Grading . The Alternative Education 
Program seeks to create structural 
changes in schools to increase indi- 
vidual ized instruction, and this 
intervention is planned by several 
of the action prefects. Accord- 
ingly, this four-it n scale aims to 
measure individut struct ion, 

by asking if indiv jl . ui learning 
plans are used, 'and if grading is 
based on improvement versus "the 
curve." The scale has a homogeneity 
coefficient of .36. 

Resources for Instruction . This 
scale is intended to measure rela- 
tive levels of resources (equipment, 
materials, learning opportunities) 
available in the school. It con- 
tains items asking about teaching 
supplies, space, extra-school set- 
tings used for instruction, and 
timeliness of availability of 
resources. This four-item scale has 
a reliability of .81 . 

Integration vs. Segregation by ^ 
Ability or Conduct . This scale is 
also included to measure an aspect 
of project implementation sought by 
the Alternative Education Program: 
the avoidance of tracking or isola- 
tion. The sj.x-item scale contains 
items such as: "Students oft mixed 
ability work together in small 
groups in my cfa.ss;" "This school ■ 
has. special classes for slow lear- 
ners;" and "In this school there are 
special classes for students who 
repeatedly misbehave."' .Its reli- 
ability is .^9, and the appropriate 
interpretation of the 'scale is 
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unclear* Opinions differ about the 
wisdom of homogeneous vs. heteroge-* 
neous grouping according to student 
conduct or a.cademic performance, 
although the current climate, and 
some evidence (Slavin, 1980), 
implies that heterogeneous grouping 
can have some virtue. 

School Race Relations . This 
brief two-item measure asks about 
race relations from the teacher 
point of view. . It asks how well 
different groups get along. Its 
reliability is .74. 

Teaching Staff Commitment . Anec- 
dotal and correlational evidence 
suggests that the commitment of an 
organization's staff is related to 
project implementation (Grant et 
al., 1979; Berman' & McLaughlin, 
1976). Accordingly, a two-item 
scale to„assess staff commitment was 
included. Its reliability is .91. 

Use of Grades as a Sanction" . The 
use of grades as a response to mis- 
conduct -is correlated with school 
disruption ra-tes (Gottfredson & 
Daiger, 1979). On the face of it, 
this also appears to be a poor prac- 
tice because it makes the grading 
and sanctioning process ambiguous. 
A two-item itidex^uses teacher 
reports to characterize the extent 
of this practice in schools . It has 
a reliability of .65. . 

Staff Morale . As with commit- 
ment., morale is sometimes suggested 
as a concomitant of success in 
implementing innovations , and it is . 
an important characteristic ■ of an 
organization in its own right, An 

* 11-item scale containing items such 
as, "Our problems in this school are 
so big that' it is unrealistic to • 
expect teachers to make much of a 

'dent in them;" and "(Is the teaching 
faculty) frustrated?" Its reliabil- 
ity is .94. 



Planning and Action * , Presumably, 
organizations engaging i%\ systematic 
planning and that are open to change 
aire most likely to successfully 
implement.' innovations. Based on 
this assumption, we constructed a 
nine-item scale to (assess planning 
and action. It asks, "How often do 
you work on a planning committee 
with other teachers?" "(Is the 
principal) progressive?" "(Is the 
teaching faculty) open to change?" 
Its reliability is .89. 

Student Influence * Student par- 
ticipation in school decision making 
is one of the major structural ele- 
ments thtr Alternativfe Education Pro- 
gram wants to create through the 
action projects. The assumption 
apparently is that student influence 
will help to create other beoief icial 
structural changes, or it may. con- 
tribute to decreased alienation or 
sense of pow'erlessness. Measures of 
student influence used in previous 
studies (National Institute of Edu- . 
cation, 1978; Gottfredson & Daiger, 
1979) assessed a limited range of 
influence, and certainly do not 
assess the kinds of student influ- 
ence possible. Therefore, although 
based on the scale used earlier by 
Gottfredson & Daiger (1979), this 
scale is expanded somewhat (to five 
items). Sample questions are "I 
often change my lesson plans based 
on student suggestions;" and "Teach- 
ers and their students work together 
to make rules governing behavior in 
the classroom."*. The scale has a 
reliability coefficient of .85. 

Smooth Administration . Our ear- 
lier research- (Gottfredson & Daiger, 
1979) suggests that the -way a school 
is run is important in understanding 
its climate and in preventing school 
disruption. To the best of our 
knowledge, detailed studies of 
school administration tend to focus 
on the'persorial Characteristics of 
administrators te.g. , Miner, 1967), 
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or are ethnographic accounts of the 
typical activities of administra- 
tor«. Here we wished to assess the 
perceptions of administrative style 
and procedures from the point of 
view of the body of teachers who 
experience them. Accordingly, we 
constructed a 12-item scale. Typi- 
cal items are: "Simple, non-time 
consuming procedures exist foj the 
acquisition and use of resources;" 
"There is little teacher-administra- 
tion tension in this school." "(The 
principal is) open." In a sense 
this scale represents a global rat- 
in^ybf the positiveness with which 
teachers view the schools's adminis- 
tration, although the item content 
focuses »on both principal behavior 
and some probable practical conse- 
quences of that behavior. Its reli- 
ability is .93. 

Safety . This 10-item scale meas- 
ures teachers' perceptiohs of the 
safety of their schools.^ It asks, 
for ^example, how safe, the class- 
rooms, halls*} restrooms etc. are. 
Its homogeneity coefficient is .94. 

Stability of the Psychosocial Cli - 
mate Measures - i 

. . ' k 

One-year stability coefficients 
for the psychosocial climate meas- 
ures derived from student reports 
are presented in Table 5, and the 
corresponding information for psy- 
chosocial climate measures derived 
from teacher reports are presented 
in Table 6. With the exception of 
the measure of school Race Rela- 
tions, these climate measures are 
fairly stable over time. 

Interpreting the School Climate 
Measures 

^ In August 1982 we prepared four 
kinds of feedback about the schools 
in which the delinquency prevention 
projects are operating. This feed- 
back, based on surveys .conducted 



with etydente and teachers, took the, 
following forms: 

o Average characteristics of 
each school 's students. 

o Reports by students about 
each school's psychosocial 
climate.^ 

o Average characteristics of 

each school * s teacherc. % 

o Reports by teachers about 
each 'school's psychosocial 
climate. 

\ > 

Formative evaluation information 
of this kind is most useful when the 
projects have developed clear ideas 
about what they expect to see. 
Accordingly , baise-line information 
from surveys conducted in t<he Spring 
of 1981 was presented, and projects 
were asked to make predictions about 
the Spring 198T* results based' on th.e 
projects' goals and objectives, and 
thei*r knowledge of the degree of 
implementation of their various 
interventions. - 

9 

Student Scales 

c 

Individual- lev el student scales 
report the average item score for 
all items in^the scale*. Scale* 
scores are c'omputed such that if a 
person gave the keyed response to 6 
items in a 12-item scale, his or her 
score would equ«1.^5(h4 As with 

— T ; r — ~ . 

5. For items with more than two 
response options (e.g. , -"yes," "no")* 
item responses were dichotomized. 
This differs from the scoring method 
used to teport scores in our previ- 
ous reports. In previous reports 
all of the variability in mulit-op- 
tion items was utilized by adding 
together standard scores for items 
to compose scales of equally 
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otlu?t' kindo of pnyehologicai meas- 
urement, norms are useful in inter- 
preting scoren because thuy tel 1 
whether a given score is high or low 
in reference to an identifiable 
population. Norms for school 
compositional and psychosocial cli- 
mate scales based on the* sample of 
schools in the Alternative Education 
Program are provided in Appendix A, 
for this purpose. 

Profi ling scores . Using these 
norms a school's climate scale 
scores can be plotted on a profile 
sheet for easy interpretation. In 
August, 1982, such profiles were 
provided for each school. The space 
required to profile each school pre- 
vents* us from presenting -the infor- 
mation in full in that fbnn here, 
the profile sheets shown in Appendix 
B can be used to plot any schools 
profile given the norms and the 
detailed school-by-school results 
enumerated elsewhere in this report. 

The profile sheets provide a ver- 
bal interpretation of the climate 
measure results for a school. This 
interpretation is based on the 
translation of percentile ranks into 
words. The translation table 
preceding the illustrative profile 
sheets shbws how percentiles map 
into verbal interpretations. 



weighted items. . The modification 
was introduced to enhance the inter- 
pretability the scales for practi- 
tioners not accustome'd to use of 
standard scores. An examination of 
the psychometric properties of; both 
kinds of scales implies that the 
current procedure is almost as effi- 
cient as our original scoring 
method. 
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TejEicJvt\r_HcaJi , J 1 , 

Teacher scales are scored by 
adding toge ther the items that com- 
pose a' scale with the item response 
scale constructed so that a high 
number always corresponds with the 
"high" end of the scale. The abso- 
lute (raw) scores on these scales 
have no intrinsic meaning, as do the 
student scales, and they can only be 
interpreted by reference to norms. 
Norms are provided in Appendix A for 
this purpose. 

Prof i ling "scores . Teacheiv cl i- 
mate scales can be profiled in the 
same way as the student' scales using 
the illustrative profile sheets*. 

Suggestions for -Using- Climate ( 
Re ports in Proiect- Planning 

The worksheet s v provided to proj- 
e cts to facilitate the construct ive 
utilization of the school climate 
measures are shown in Appendix C. 
These .worksheets are used to matce v 
discrepancies between what implemen- 
ters expect to see and what they 
actually observe salient. Some 
projects found it more- useful ,to i 
examine 'this information in alterna- 
tive formats. 

Using Measures fot Individual Stu - , 
dents and' Teachers 

The confidential individual-level 
measures are presented in the form 
of statistical summaries for treat-' 
ment and comparison group youths for 
each of the delinquency prevention J 
projects. Interpretation of these 
individual-level measures is made 
within the context ,of «the evaluatk^ny 
design for each of the various proj- 
ects, and these results are dis- /- 
cussed in the project-specific eval- 
uation reports in Part II of this 
report for each project that has 
project components targeted at 
well-defined groups and an evalua- 

{ 
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tion design that enables an 
assessment of these project compo- 
nents. 

The Utility of Information for Proj - 
ect Managers 

• In workshops conducted in August, 
>198i, and again in August, 1982, 
school prbfiles were made available 
to project' directors . These pro- 
files provided assessments of 
schools useful for- diagnostic anil 
prescriptive purposes. The efforts 
of thousands of sjtudfents and teach- 
ers in completing these surveys 
.would go partly to waste if this 
information were not used in project 
planning -£nd .continued project 
development. We earnestly hoped- 
that this information would be used, 
and are gratified that several proj- 
ects have made extensive use of this 
information in renewed project plan- 
ning. * - t 



Similarly, interim feedback we 
have provided to project directors 
on the characteristics of their 
clientele (in summary form) , and 
about the effectiveness of their 
interventions based on the statisti- 
cal analyses of individual scales is 
intended to be used in refining 
interventions. No one expects to 
see dramatic effects of projects in 
their developmental stages, but pro- 
gress in at least koine areas is to 
be expected. Projects will increase 
in effectiveness largely by using 
the information provided by this 
interim feedback. A subsequent 
chapter provides an overview of the 
changes in school characteristics 
across years, and Part^II of this 
interim report describes interim 
evaluation results for those por-^ 
tions of each project targeted at 
identifiable groups of youths. 
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The Alternative Education Program: Kinds of Projects and the Youths Involved 



The seventeen delinquency preven- 
tion projects that are the focus of 
the School Action Effectiveness 
Study are diverse.. Providing a 
brief account of the similarities 
among them and their major differ- 
ences is therefpre a difficult task: 
They differ in size, goals, theoret- 
ical rationales, stage of develop- 
ment, and in many other ways as 
well. Nevertheless, it is possible 
to characterize each project in 
terms of some crosscut ting dimen- 
sions. 



CrosscuttinR Dimensions 

The first conceptual dimension 
along which 'any delinquency preven- 
tion project may be placed is a 
dimension of primary prevent ion vs. 
secondary or tert iary prevent ion . 

Primary prevention . Primary pre- 
vention is activity directed to 
reduce the risk of delinquent behav- 
ior in a population. Making provi- 
sion for safe water supplies and 
environmental sanitation is an exam- 
ple of a primary prevention activity 
in the health area: It is intended 
to reduce the population's risk of 
diseases transmitted by water. The 
efficacy of- this approach to health 
promotion is unquestionable . Making 
rules in a school or community 
..clearer and more widely understood — 
is an example of a primary preven- 
tion activity in the delinquency ) 
prevention area. Such an' activity 
would be intended to reduce^/the risk 
that young people in the school's or 
community's population will engage 
in. del inquent- behav ior . a In primary 
prevention, the emphasis is on 
reducing the incidence or severity 
of some target problem in* the popu- 
lation at large . 



Secondary prevention . Secondary- 
prevention is activity directed at 
redut'ng the occurrence of some neg- 
ative outcome for persons believed 
to be at especially high risk of 
exhibiting that negative outcome. 
The administration of drugs and the 
restriction of sodium' intake ,to man- 
age blood pressure for hypertensive 
individuals who are at high risk of 
s ubs equent cardiovascular disease is 
an example of a secondary prevention 
activity in the health area. These 
interventions are intended to reduce 
the risk of strokes and heart 
attacks for persons with high blood 
pressure. Prior research shows that 
drugs and restricted sodium intake 
control blood pressure, but that it 
is difficult to get people to adhere 
to the prescribed regimens. Provid- 
ing young people who are performing 
poorly in school and who are in dis- 
ciplinary dif f icul ty^ in school with 
academic curriculum and learning / 
structures tailored to their needs 
and using the techniques of applied 

""behavior analysis to assist them a in 
managing^ their conduct is an example 
of a secondary pr event ion ac tivi ty 
in ,the delinquency prevention area: 
T he s e^^jr xt e rv ph t i on s are intended to 
reduce the risk of future delinquent 
behavior _ for' youths already at sub- 
stantially elevated risk of display- 
ing such behavior. The emphasis in 
secondary- prevention is on reducing 

-t-he--incrdent:e or severity of some 
target problem in a selected subset 
of the population that is considered 
to be at unusual .risk. 

Tertiary prevention . Tertiary 
prevention is for the most part 
synonomous with the colloquial use 
of the term !l r ehabil i tat ion. 11 .Sur- 
gery to remove an inflamed appendix 
is an example^ of tertiary prevention' 
in a medical- context. A rehabilita- 



56 



Proj ect s 



tion program for incarcerated 
offenders might be an example of a 
tertiary prevention program ,in the 
dei inquency area. Tertiary preven- 
tion is usually not regarded as a 
form of prevention, but rather as a 
form of remediation. 



Individual vs . Environment 

A se cond conceptual dimension 
along which any delinquency preven- 
tion project may be placed ifl^a 
dimension of a focus on the adapta - 
tion of' the individual vs. a focus 
on altering the environment . 

Promoting individual adaptation 
or resistance . The promotion of 
individual adaptation or resistance 
to negative sources of influence is 
activity directed to "innoculate" 
the individual against sources of 
harm or to enhance the ability of 
the person to adjust to or cope with 
an environment. An example of an 
intervention aimed at preventing 
disease through this approach is the 

innoculation of individuals against 

'i 

smallpox. After introducing a non- 
virulent strain of a micro-organism, 
the immune system develops defenses 
against subsequent invasion by viru- 
lent strains of the same organism. 
For some well understood diseases 
this . approach is of unquestionable . 
utility. An example of an interven- 
tion aimed at preventing delinquency 
through this approach is one aimed 
at strengthening a person's attach- 
ments to prosocial others so that he 
or she develops greater stakes in 
conformity. In tertiary prevention, 
the emphasis is on reducing the fur- 
ther inciSence or severity of a tar- 
get problem in the subset of the , 
population that has already exhi- 
bited the problem. 

Altering the environment . Inter- 
ventions adopting an approach of 
altering the environment aim to eli- 
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m ina te or attenua te sources of , 
inf luence in the env ironment than 
contribute to problems. ^ An example 
of an .intervention in the health 
area using this approach is the use 
of dust extractors in grain storage 
silos to reduce the risk of death 
resulting from the explosion of the 
silos. Such interventions have 
proven to be of considerable value. 
Examples of interventions adopting 
an approach of altering the environ- 
ment in the delinquency prevention 
area include projects that widely 
disperse immigrants and families 
with low socioeconomic status 
throughout urban areas rather than 
allowing them to concentrate in 
urban slums, and interventions that 
alter the reward structures of 
schools so that individuals experi- 
encing difficulty in academic work 
will not experience only failure in 
school. 

A Classification of Prevention Rroi- 
ec ts 

The foregoing two dimensions can 
be used to create the classification 
of Alternative Education Prevention 
prevention projects illustrated in 
Figure 1.* Quadrant 1 (the upper 
left quadrant) includes primary pre- 
vention projects focused ma.infcy on 
environmental factors that contri- 
bute to delinquency. They aim to 
reduce the risk of youth crime for a 
t6tal population. The effectiveness 
of Quadrant 1 interventions should 
be reflected in epidemiological 
indicators of youth characteristics 
and behavior. Their interventions 
should be such that everyone, or 
nearly everyone, in the target popu- 
lation is affected by them. 



1. For a related classification 
with different content see Associ- 
ates for Youth Development, 1980. 



A Classification 



Figure 1 
of Preventive 



Intervent ions 



Alter the 
environment 



o Target is the 

popula tion. 
o Focus is change in 

structures, policies 

procedures » 

Example : Changing 
disciplinary pro- 
cedures. 



Primary 

prevention 



) Target is the 
population. 

) Focus is altering^ 
individuals 1 be- 
haviors, attitudes, 
or competencies. 

Examples: Law- • ' 
related education, 
career development 
ass istance . 



o Target is a selected group 1 
of high risk indiv "duals. 

o Focus is change in struc-* 
tures, policies, procedures. 

Example: Reducing availability 
of school area* for- gang 
activity or conflict. 



Secondary > 
_ter tiary 
prevention 



o Target is a selected group 
of high risk individuals. 

o Focus is altering individuals' 
behaviors , at titudes , 
or- competencies. 

Example': Counseling or 
psychotherapy for high-risk 
y oiiths or offenders . 



Adapt the 
Individual 



-45- 



58 



V 



Projects 



Quadrant' 2 (the upper right 
quadrant) includes secondary and 
tertiary prevention and remediation 
projects focused mainly on environ- 
mental factors that contribute to 
delinquency. They aim to reduce the 
risk of youth crime for a group of 
individuals who are at high risk of 
displaying delinquent behavior. 
Their effectiveness should be 
reflected in measures of the per- 
sonal characteristics and behavior 
of youths in the selected, high-risk 
group who receive the direct ser- 
vices ox treatments of the project. 
Quadrant 2 interventions should be 
such that the treatments are deliv- 
ered to members of the target group 
with sufficient strength and integ- 
rity to prevent further exposure to 
. environmental conditions promoting 
delinquent behavior, to create envi- 
tjft. ronmental conditions that restrain 
the individual from delinquent 
behavior, and (if a tertiary preven- 
tion project) remediate existing 
problems or rehabilitate an offen- 
der. 

Quadrant 3 (the lower left quad- 
rant) includes primary prevention 
projects focused mainly on adapting 
people to their environments. They 
aim to reduce the risk of youth 
crime in a total population by 
enhancing the ability of people in 
an environment to adjust to or cope 
with the environment. Quadrant 3 
interventions should be such that 
everyone* or nearly everyone, in the 
population is affected by the inter- 
ventions in ways that foster adjust- 
ment or adaptation. Their^effec- 
tiveness should be reflected in . 
epidemiological indicators of the 
attitudes, behavior, or personal 
characteristics of the population. 

Quadrant 4 (the lower right quad- 
rant) includes projects focused 
mainly on adapting individuals to 
the situations in which they find 
themselves. They aim to reduce the 



risk of subsequent delinquent 
behavior by individuals in a target 
group of high risk individuals. 
Quadrant 4 interventions should be 
such that the treatments are deliv- 
ered to members of the target grouf> 
with sufficient strength and integ- 
r ity to develop. personal restraints 
from engaging in delinquent behav- 
ior, prevent further development of 
personal characteristics promoting 
delinquent behavior, or (if a terti- 
ary prevention project) remediate 
existing problems. Intervention, 
effectiveness should be reflected in 
measures of the personal character- 
istics and behavior of youths in the 
selected, high-risk 1 group* who 
receive the direct services or 
treatments of the project. 

Like any typology, the present 
one is an abstraction — these are 
ideal types. No project " is likely 
to resemble one and only one of- 
these ideal types. In actuality, 
most projects will have characteris- 
tics in common with two or more of 
these 'approaches. The typology is ■• 
nevertheless useful in providing a, 
general characterization of preven-^ 
tion projects. 

The Classification Applied to the 
Alternative Education Projects 

In Table 1 the foregoing classi- 
fication is applied to the 17 proj- 
ects, being evaluated in the School 
Action Effectiveness Study. We have 
considered what these prevention 
projects are doing and what they aim 
to accomplish, and then used our 
best judgment in preparing the 
table. The classification of a par- 
ticular project in one category or 
another does not imply that it is a 
pure type, or even that the classi- 
fication is particularly apt. The 
primary cla'ssif ication means that, 
in our judgment, the project most 
resembles that type. 
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* Table 1 

A Classification of the Alternative Education Project^ 



Project 


*Trimary type 


Secondary type 


Compton, CACYD 


Secondary /Individual 


Prima ry/Env ironment 


Pasadena, STATUS 


Primary/Individual 


Primary /Env ironment 


Chicago, PCD 


Secondary /Individual 


P r ima ry /-Env ir onifren t 


Chicago, RETAIN 


Secondary /Individual 




Kalamazoo, AEP 


Primary /Environment 


Secondary /Env ironment 


South Bronx, PREP 


Secondary/Environment 


Secondary /Individual 


East Harlem, AAEP 


Primary /Individual 




Puerto Rico, OC 


Primary/Environment i 


Secondary /Individual 


Charleston, PATHE 


Primary /Environment 


Secondary /individual 


Houston, GIS 


Secondary /Environment 


Secondary /Individual 


Virgin Islands, AEP 


c Secondary /Individual 


Primary /Env ironment 


Hay ward, LCO 


Primary /Environment 




Miami , ACE 


Secondary/Environment 


Secondary /Individual 


New* Jersey, EIC-S 


Secondary /Environment 


Prima ry/Env ironment . .. 


Plymouth, AEP 


Secondary /Individual 




Milwaukee, JVS 


1 Secondary /Individual 




St. Paul, Together 


Primary /Environment 


Secondary /Individual 



t 

-47- 



60 



Projects 



For ;a fuller description of each 
project see the detailed project 
descriptions .in our first interim 
report, and in the second interim 
report, part II. Those fuller 
descriptions make clear that: simple 
classifications do not portray the 
full complexity of any of these 
projects.. 

What Are The Interventions ? 

> 

The individual interventions 
being implemented by the projects 
sp$n a wide range „of educational 
approaches and techniques. Table 2 
categorizes a majority of the inter-* 5 
Ventions being implemented by the 
projects. An "X" indicates only 
that we have reason to believe that 
some version of that particular 
intervention has actually occurred. 
No attempt is made here to judge "the 
strength, fidelity, integrity, theo- 
retical reasonableness, or effec- 
tiveness of a particular interven- 
tion within a project. Many of the 
interventions are, in fact, only, 
weakly implemented. "The main pur- 
pose of the table is to give some 
idea of the scope and diversity of 
interventions across the entire 
Alternative Education Program, and 
within any particular project. 

Who Are the Target Populations ? 

The evaluation's data base shows 9 
that a cumulative total of 6,548 
youths were the targets of direct 
interventions between September 1980 
and April 1982. The number of 
youths subject to indirect inf luence 
by the projects is larger: A total 
of 23,934 youths were indirect tar- 
gets of interventions of projects 
with primary prevention components 
in the schools in which they oper- 
ate. Detailed information on the 
numbers of youths involved in each 
project is provided in Table 3. The 
first column shows, the cumulative 
number of youths receivihg~direct- 



services as part of the Alternative 
Education Program. This number 
ranges from 88 to 1,151 across the 
projects. The second column shows 
the number of youths receiving 

/ direct services as of April ,1982. 
The third column shows the number of 
students indirectly served by proj- 
ects with appreciable preventive 
intervention aspects in the 1980-81 
academic year, and the fourth column 
shows the corresponding information 

^fok the 1981-82 academic, year. 



A icore detailed description of 
the youths potentially affected by 
the Alternative Education Program is 
provided in' Tables 4> through 6. 
These tables show estimated ethnic 
group and sex breakdowns. These 
estimates are made using ethnic and , 
gender self-identification on the 
Spring 1982 School Action Effective- 
ness Study surveys. 

The Alternative Education Program 
mainly involves ethnic minorities. . 
Table 4 shows the ethnic composition, 
of public schools in which delin- 
quency prevention projects are oper- 
ating. ^ Table 4 shows that only 
32.7% of the schools' population are 
white, 36.6% are Black, 24.7% are 
Spanish-speaking or Spanish sur- 
named, 1.5% are Native American, 
1.7% are Asian-American, and 2.7% 
gave some other ethnic self-identi- 
fication. The ethnic composition of 



2. The N's shown in the table are 
not equal to^the N's in Table 3 
because~'6f survey or item nonres- 
ponse, and because the indirect ser- 
vice totals of Table 3 qre derived 
from principal questionnaires about • 
school enrollment, *hilej the samples 
for Tables 4 to .6 were drawn from 
actual school rosters. The table 
also shows the ethnic composition of 
several non-intervention schools 

which-serve as "control 11 ' ' >ols in 

the evaluation. 
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Table 2 



Characteristics and Interventions of -the 
Alterna tive Educat ion Projects 



Project school characteristics 
Program operates in: / 

Regular school 

Alternative school 
Organization of target 
school(s ) : 

Elementary school 

Junior/middle school 

High school 

Project intervent ions 
Curriculum development 
Individualized instruction 
or tutoring ± 
Teacher del Wlted 
Peer delivered 
Computer delivered 
Vocational/career education 
Adaptive/affect ive educat ion 
Teafcher training/development 
Individual counseling 
Gr^oup/peer counseling 
Change classroom manage- 
ment/ organization 
Increase extra-curricular 

activities 
Change school sanction 1 
procedures 
. Discipline 

Suspensions 
Increased student participa- 
tion indecision making 
Improve school climate 
Involve community in school: 
Channel resources into 

school 
Parental involvement 
Involvement of persons 
other than parents 
Improve parent-student 

relations . " • 
Diversion from juvenile 
justice system - . 



1 


2 


3 


4 


5 


Project 
6 7 8 


Number 
9 10 11 


12 


13 


14 


15 


16 


17 


















I 
















X 


X 


X 


X 


X 


X X 


x 


X 






X 


X 


X 


X 


X 










X 


X 




X 


X 


X 


X 




X 












































X 


X 












X, 


- 




X 


X 






X 


X 


X X 


X 


X X 


X 


X 


X 


X 




X 


X 


X 


X 


X 






X 


X 


X 


X 


X 


X 




X 


X 




X 






X 




X X 


X 


X 








X 


X 


X 


X 


X 




i 

X 


X 


X 


X X 


X 


x k 




X 


• 

X 




X 
















X v 


















X 


















X 










X 


X 










X 


X 


X 


X X 


• 


X 






X 


X 


X 


X 


X 




X 


X 






X X 




X 




X 


X 


X 


X 


X 


X 




X 


X 


X 


X 


X* X 




X 


X 






X 


X 


X 




X 


X 


X 


X X 


X 


X 


X 


X 


X 


X 


X 




X 




X 




X 


X 




X 


X 






X 


X 




X 


X 


X 






X 




X 


X 


X 




X 


X 






X 


X 








X 


X 


X X 


X 


X 


X 


X 


X 






X 














V 


















X 


X 


X 




X 






X 


X X 




X 




X 




X 


X ' 


X 






X 






•X 


X 


X 






X 




X 


X 


X 


X 




X 


X 


X X 


X 


X . 


X 


X 


X 


-X 




X 


X 


X 


X 




X 






X 


X 




X 








» 

X 


X 








X 


X 




X 


X X 




X 


X 






X 


X 








X 


X 


X X 


X 


X 




X 


X 


X 




X 


X 








X 




X 


X 


X 




X 


X 






X 


X 






X 


X 


X 




X 








X 


X 




X 


X 




X 






X 


, x - 




X 








X 


X 





l=Compton-CACYD 
2=Pasadena-STATUS 
3=Chicago-PCD - 
4=Chicago-RETAlN 
5 =K al am az o o- AEP 
6=South Bronx-PREP 



7=East Harlem-AAEP 
8-Piierto Rico-OC 
9 s =Charleston-PATHE 
10=Houston-GIS 
ll=Virgin Islands-AEP 
12=Hayward-LC0 



13=Miami-ACE 
14=New Jersey-ElC-S 
15=Plymouth-AEP 
16=Milwaukee-JVS 
17=St. Paul-Together 
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Table 3 



Cumulatuve and Current Number of 
Clients Receiving Services 





Total Receiving 
Direct Services 


Total Receiving 
Indirect Services 


Project 


Cumulative 
to Apr. '82 


Current in 
, April '82 


1980-81 


1981-82 


Compton ✓ 
Constitutional Rights 


% 132 
' 421 d 


65 
25 0 d 


0 

3,445 


0 

3;069 



Foundation, Pasadena 
Peer Culture Development, 

Chicago i 
Chicago Board of Education 
Kalamazoo 
Bronx 

Jazzmobile, Harlem 
Puerto Rico 
Charleston 
Houston 
Virgin Islands 

Lac Courte Oreilles, Hayward 
Miami 

Plymouth-Canton 
New Jersey 

-Je^ish-.-YacationaL Services , 
Milwaukee 
St. Paul 



946 

205 
115 
329 
781 a 
976 d 
1,151 
119 
88 
1 24 b 
114 
213 
154 
329 c 

351 



432 

y 

' 128 
115 
150 
25 l a 
491 d 
. 630 
75 
53 
100 b 
85 
161 
154 
329 c 



5,531 
0 

657 
0 
0 

2,245 
4,597 
0 
0 

100 
0 
0 
0 
0 



5,712 
0 

665 
0 
0 

1,608 
4,078 
0 

1,356 
95 
0 
0 

2,812 
0 



318 



3,722 



4,539 



Note . Counts are based on the number of clients who received at least 
some direct program services, according to information provided to the 
National Evaluation Management Information System. Clients not named or 
identified with an ID number are not entered into the MIS. Direct ser 
vice recipients include all students enrolled in or receiving services 
through a program component. Indirect or preventative services are 
recorded only for projects involving a substantial school change or pri- 
mary prevention component. 

a Figures do not include students currently enrolled in the elementary 
school program. » 

^Figures do not include 1981-82 youth center clients. 

C These figures do not include Return Center clients and MYEC clients who 
entered the prqgram after the "evaluation phase" which ended in January, 
1982. 

d These figures reflect the number served through May, 1982, because no 
data were available in April. 
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Table A 

Ethnic Composition of Schools in the Alternative Education Program 

Spring, 1982 _ ^ 

Row Percentage 

"Si ^ - Sul Jm^^ Other "ff" 



Pasadena , Cal if ornia 
School 70 
School 82 

Project subtotal 
Peer Culture Development, 
Chicago 

School 1370 
School lASO 
School 1820 
School 3200' 
School A720 
School 5070 
School 5550 
School 6010 

Project subtotal 
Chicago Board of Education, 
Chicago * 
School 12A0 
School 13A0 
School 2300 
School AAA0 
School A550 . 
School 5090 
School 5750 

' School 5880 

School 6180 

Project subtotal 
Kalamazoo, Michigan 
School 318 
School 327 

Project subtotal 



1./66 
0.87 
1.18 



0.27 
0.55 
0.30 
0.00 
0.67 
1.35 
3.26 
'1.08 
0.A3 



0.00 
0.00 
2.82 
0.00 
0.87 
0.55 
0.61 
-1.06. 
0.79 

0. 50 

1.27 
1.69 

1. A7 



6.21 
2.69 
A. 06 



0.7A 
6.05 
1.21 
0.9A 
1.33 
5.A1 
7.61 
1 .08 
1 .88 



0.1A 
0.59 
7.91 
2.86 
0.00 
0.00 
0.61 
. 0.2A 
0.00 
0.90 

1.09 
1.06 
1.08 



19.45; 
1A.38 
16.35 



A3. 98 
A5.03 
AA.62 



23.28 
31.95 
28.58 



5. A3 
5.08 
5.22 



876 
1377 
2253 



68. Al 


27.71 


2.12 


0.7A* 


.1097 


61.26 


7.86 


21.31 


2.97 


732 


26.02 


22.35 


A9V21 


0.91 


3298 


30.19 


A. 72 


59.43 


A. 72 


106 


9A.00 


0.67 


3.33 


0.00 


150 


28.38 


43. 2A 


20.27 


1.35 , 


7A 


56.52 


5. A3 


25.00 


2.17 


92 


89.17 


3.25 


A. 33 


1.08 


277 


A3. 77 


19.75 


32.96 


1 .22 


'' 5826 



56.32 


38.91 


0.00 , 


A. 63 


720 


13. AO 


50.81 


32.99 ' 


2.21 


679 


59.89 


2.26 


23.73 


3.39 


177 


A3. 81 


33.33 


17. 1A 


2.86. 


105 


0.87 


98.26 


0.00 


0.00 


115 


32.97 


0.55 


59.34 


6.59 


182 


0.61 


97.58 


0.00 


0.61 


165 


82.77 


11.25 


2.08 


2.61 


A10. 


15,75 


77.95 


0.79 


A ;72 


127 


39.92 


A0.A5 


1A.98 


3.25 


2680 


3.27 


21.82 


69.09 


3.A5 


550 


1.91 


35.55 


52.88 


1.91 


A66 


2.65 


28.11 


63.95 


2.75 


1016 













continued 
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Table 4 (continued) 

Ethnic Composition of Schools in the Alternative Education Program 

Spring, i982 

Row Percentage 

City, School, Native 'Asian Spanish Weighted 

and Project American American American Black White Other N 



South Bronx, New York 
•School 22 
School 55 
School 63. 
School 64 
School 82 
• School 117 
School 132 
School 1*5 
School 147 
School 148 
School 166 
School 229 

Project subtotal 
East Harlem, New York 
Project subtotal 
Playa do Ponce, 
Puerto Rico 
School 1 
-School 2 - 
School 3 

Proj'ect subtotal 
Charleston , 
South Carolina 
School 242 
School 741 
School 742 
School 743 
School 751 
School 754 
School 755 
School 944 
School 951 

Project subtotal 
St. Croix, 
Virgin Islands 

Project subtotal 



2.27 
0.00 
3.68 
3.33 
1.23 
2.73 
0.00 
1.60 
3.80 
2.71 
1.60 
2.50 
2.20 

3.31 



0.83 
1.84 
0.39 
1.00 



0.97 


46.28 


44.98 


2.91 


* 2.59 • 


309 


1.64 


22.95 


70.49 


3.28 


• 1.64 


61 


0.00 


' 39.71 


52.94 


0.74 


2,94 


136 


0.00 


69.17 


. 20.00 


4.17 


3.33 


120 


0.41 


45.08 


50.00 


2.46 


0.82 


244 


0.7..8 


59.77 


31.25 


0.39 


5 .08 


. 256 


0.00 


35.37 


60.98 


1.22 


2.44 


82 


0.40 


43.90 


51.80 


0.80 


1.60 


378 


0.80 


* 29.50 


63.60 


0.80 


1.50 


200 


0.68 


26.78 


66.78 


1.02 


2.03 


295, 


0.00 


40.80 


54.50 


0.60 


2.50 


629 


0.50 


21.50 


72.50 


0.00 


3.00 


200 


0.40 


\ 40.70 


52.90 


1.20 


2.50 


2941 


0.83 


11.57 


82.64 


0.00 


1.65 


121 



2.22 
0.00 
0.39 
0.84 



87.50 
87.56 
92.52 
89.79 



1.39 
0.92^ 
0.59 
1.00 



7.78 
8.76 
5.71 
6^5 



0.28 
0.92 
0.39 
0.42 



360 
217 
508 
1195 



0.40 . 


0.40 


0.80 


41 .50 


54.80 


2.00 


451 


1.40 


0.76 


1.66 


95 .40 


0.00 


0.77 


393 0 


0.64 


0.51 


1.02 


96.42 


0.26 


1.15 


t 392 


1.12 


0.00 


0.26 


97.41 


0.43 


0.78 


382 


,0.32 


0.50 


0.50 


98.36 


0.00 


0.32 


313 


0.00 


0.47 


0.23 


99.06 


0.23 


' 0.00 


426 


0.96 


0.14 


0.00 . 


98.48 


0.00, 


0.42 


717 


1.49 1 


. 0.29 


1.49 


66.67 


27.57 


2,48 


339 


1.02 


0.00 • 


0.43 


78.53 . 


19.00 


1.02 


623 


0.80 


0.30 


0.60 


85.80 


t 11.50 


1.00 


4036 


.29 


0.00 


30.99 


65.43 


1.19 


2.40 


1041 



continued 



65' " 52 " 



Table 4 (cont inued) 

Ethnic Compos i t ion of Schools in the Alternative Education Program 

Spring, 1982 



City , School , 
and Project 



Row Percentage 



Spanish 
American 



Native Asian 
American American American Black White 



Other 



Weighted 
N 



Plymouth, Michigan 

School 31 

School 41 

School 42 

School 43 

Project subtotal 
New Jersey 

School 1 

School 2 

School 3 

School 4 

Project subtotal/ 
St. Paul 

School 210 

School 230 

-School 34 2 

School 33 2 r 
ProjtM t subtotal 

Total 



1.68 


1.51 


1.35 


0.17 


88.89 


6.41 


604 


1 .68 


0.12 ' 


1.5T 


0.00 


92.05 t 


•4.59 


861 


0.00 . 


3.57 


0.89 


0.00 


92.86 


2.68 


112 


0.00 


2.80 


0.00 


1 .87 


88.79 


6.54 


107 


1 .44 


1.00 


1.38 


0.18 


90.78 


5.22 


1710 


1 .6* 


0.00 


30.34 


15M7 


44.94 


7.87 


178 


1.03 


0.69 


3.10; 


14 .25 


74.84 


6.0C 


924 


4.64 


0.00 . 


8.21* 


67 .*14 


17.14 


2.86 


280 


1.69 


0,56 


16.01 


12.92 


65.17 


, 3.65 


356 


1.82 


0.48. ' 


9.36 


22 .59 


60.50 


5.25 


1738 


1.60 


3.95 


^1.68 


29.31 


59.09 


. 4.37 


1207 


1 .73 


8.63 


3. -8 8 


3.02 


80.58 


' 2.16 


1323 


2.98 


0.72 ' 


0,93 


14 .94 


76.09 


4.33 


478 


6.82 


7,82 


5.02 


6 .69 


65.45 


8.21 


353 


2.39 


5,58 


2.77 


14.75 


70.48 


4.02 


3456 


1.50 


1.70 


24.70 


36.60 


32.70 


2.70 


28378 



•53- 




ERIC 



66 



Table 5 

KihiuO Self-ldeniil ication of Students Receiving Direct Service*, 
Alternative education Program, Spring 1982 



Row Percentage 



City, School , 
and Project 


Np t ive 
Ame r i c an 


Asian 
Amef i c an 


S pan i b h 
Ante r icon 


Black 


Whiff 

r 


Other 


N 


Cotupton, California 














57 


CACYD 


3.51 


5 . 26 


8.77 


77.19 


1.75 


3.51 


P .is a den a, California 














82 


School 70 


2 '.43 


2.43 


24.31 


44.98 


18.55 


7.29 


School 62 


0.96 


5.77 


11.54 


M .54 


16,35 


3.85 


104 


Project subtotal 


1.61 


4 . 30 


17.18 


54.22 


1 / . J L 


- 5 • J / 


1 OD 


Pt?er Culture Development, 
















Chicago 








50'.45 




0.00 


in 


School 1370 


0.90 


0.00 


42.34 


6.31 


School 1430 


3.16 


1 .05 


60.00 


18.95 


13,68 


3.16 


95 


School 1820 


0.00 


0.00 


12.82 


37.18 


50,00 


. 0.00 


78 


School 3200 


0.00 


0.00 


20.83 


0.00 


75.00 


4.17 


24 


! School 4720 


0.00 


3.85 


88.46 


Q.OO 


7.69 


0.00 


26 


School 5070 \ 


4.55 


0.00 


27,27 


50.00 


18.18 


0.00 


22 


School 5550 


3.33 


6.67 


43.33 


13.33 


33.33 


0.00 


30 


School 6010 


2.38 


0.00 


83.33 


4 .76 


9.52 


0.00 


42 


Project subtotal 


1.64 


0.93 


45.99 


28.04 


22.66 


0.93 


428 


Chicago Board of Education, 
















Chicago 










0,00 


0.00 




School 1240 


0.00 


0.00 


66.67 


33.33 • 


f» 


School 1 340 


0.00 


0.00 


. 0.00 « 


0.00 


|00i00 


0.00 


1 


1 School 2300 


7.14 


0.00 


57.14 


7.14 


* 28.57 


0.00 


14 


School 4440 


0.00 


0.00 


25.00 


66.67 


8.33 


0.00 . 


12 


School 5090 


0.00 


0.00 


57.14 


7.14 


21.43 


14.29 


14 


School 5750 


0.00 


0.00 


o.oo 


100.00 


0.00 


0.00 


11 


k School 5880 


0.00 


6.30 


93.70 


0.00 


0.00 


0.00 


16 


School 6180 


7.69 


0.00 


23.08 


69.23 


0.00 


0.00 


13 


Project subtotal 


2.30 


1.15 


47.05 


36.84 


10.36 


2.30 


87 


Kalamazoo,' Michigan 












3.09 


97 


School 318 


1.03 


1 .03 


2.06 


28.87 


63.92 
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Tntitf 5 (toil! limed ) 



Mhnic Sell -MriU it ication of Si wdent s, Krceiv mu 
Alternative Munition I'ninriiiti, Snr hi* 



Hi i i-t t tin v \ i 



City, School, 
arid Project 



Amcr ic an 



Am«*r i c«n 



How lVrcrnLatfe 



Spahiuh 
Aiur r i can 



Black 



White 



Of he r 



South Bronx, New York 
School 51 

School 55 \ 
School 6 3 
School M 
School H2 
School 117 
School 132 
School 147 • 
School 148 
, Project subtotal 
East Harlem, New York 

School 88 
Playa de Ponce* 
Puerto Rico 
School 1 
School 2 
School 3 

Project subtotal 
Charleston, South . 
Carolina (PA THE) 
School 741 
School 742 
School 743 
School 754 
School 755 
School 944 
School 951 

Project subtotal 
Houston, Texas 1 * 
Project sutft 
St. Croix, 
Virgin Islands 

Project/ subtotal 



otal 



6.4S 

0.00 

0.00 

O.OO 

0.00 

0.00' 

0.00 

0.00, 

5.56 

2.29 

4.88 



0.56 
2.22 
0.70 
1.00 



3.03 
2.13 
1.67 
0.00 
0.00 
0.00 
0.00 
1.01 

0.00 



3.70 



0.00 
0.00 
0.00 
0.00 
0.00 
0.00 
0.00 
0.00 
0.00 
0.00 

1.22 



3.39 
0.00 
0.35 
1.17 



1.52 
2.13 
0.00 
1.72 
1.59 
. 0.00 
0.00 
1.01 

0.00 



\ 



25.81 


61.29 


0.00 


6.4'j 


27.27 


72. 73 


0.00 


o.ocf 


33.33 


66.67 


0.00 


0.00 


90.06 


10.00 


, 0.00. 


0-po 


33.33 


66.67 


0.00 


/Coo 


40.00 


' 60.00 


0.00 


'o.oo 


21 .43 


71 .43 


0.00 


7.14 


14.29 


85 .71 


0.00 


Q.00 


5.56 


88.89 


0.00 


0.00- 


29.77 


. 65.65 


0.00 


2:29 


12.20 


• 79.27 


o.'oo 


2.44 



^0.00 



84.75 
88.15 
92.31 
89.15 



7.58 
0.00 
1.67 
0.00 
0.00 
0.00 
0.00 
1.51 

^4.64 



40.74 



2 .82 
1 .48 
1.05 
1 .67 



87.88 
95.74 
95.00' 
96.55 
98.41 
66.00 
87 .04 
89.95 

0.00 



48.15 



7.91 
6.67 
5.59 
6c. 51 



0.00 
0.00 
0.00 
1.72 
0.00 
32.00 
12.96 
6,03 

1.79 



7/41 



0.56 
'l.48 
0.00 
0.50 



0.00 
0.00 
1.67 
0.00 
0.00 
2.00 
0.00 
0.50 

3.57 



0.00 



31 
It 
15 
10 
15 
10 
14 
7 
IB 
131 

8? 



177 
135 
286 
599 



6b 

47 

60 

58. 
-63 

30 

54 
398 

56 



2? 
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Tabl e 5 ( cont i nued ) 



Ethnic Sell - IdciU i f icat ion uf Students Receiving Direct Services, 
Al tenia t ive Educa t i on Program , Spr ing 19 82 



Row Percentage 



City, School, Native Asian Spanish ' 

and Project American American American Black White Other 



Hoy ward ( LCO ) 



Project subtotal 


n. 


63 


H i am i 






Project subtotal 


0. 


00 


Plymrv. h , Michigan 






Gr- wth Wortfs 


' 0. 


00 


School 31 


0. 


00 


School 41 


5 . 


,60 


flehool 42 


3. 


,40 


School 43 


2. 


,30 


Project subtotal 


2. 


.40 


New Jersey 






School 1 


0, 


.00 


School 2 


0 


.00 


' School 3 


4 . 


.17 


School 4< 


0 . 


.00 


Project subtotal 


1 


.15 


St. Patri 






School 210 


0 


.00 


School 230 


0 


.00 


School 342 


0 


.86 


School 352. 


0 


.00 


Project subtotal 


0 


.22 



0.00 v 


0.00 


0. 


00 


1.37 


0. 


00 


73 


0.00 


16.18 


51 . 


,47 


32.35 


0. 


00 


68 


O.00 


3.20 


0, 


.00 


93.50 


3. 


20 


31 


0.00 


0.00 


0 


.00 


92.90 


' 7. 


,10 


14 


0.00 


5.60 


0 


.00 


88.90 


0. 


,00 


18 


1 .70 


0.00 


' 0. 


.00 


87.90 


6.90 


58 


0.00 


0.00 


2 


.30 


88.40 


7.00 


43 


0.60 


1.20 


0 


.60 


89.60 


5, 


.50 


164 


0.00 


63.64 


13 


.64 


22.73 


0 


.00 


22 


O.00 


0.00 


5 


,26 


84.21 


10 


.53 


19 


0.00 


8.33 


75.00 


8.33 


4 


.17 


24 


0 ; 00 


4.55 


13 


.64 


54.55 


27. 


.27 


22 


o'.oo 


H9.54 


28 


.74 


AO. 23 


10 


.34 


87 


0.7 3 


4.06 


.31 


.94 


61.08 


2 


.18 


275 


0.00 


0.00 ' 


0 


.00 


100.00 


0 


.00 


2 


0.00 


3.83 


18 


.70 


.- 74.88 


1 


.72 


116 


19.04 


1,3? 


8 


.11 


62.91 


8 


.11 


55 


2.7H 




25.44 


65.06 


2 


.78 


448 
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Table fi 



v '« 



Gander Self-Identification of Students in Participating Schools 
and of Students Receiving Direct Services, Spring 1982 \ 



Total School 



Direct ly Served 





/o 


7 
/, 


We lghted 


7 

/o 


/o 




City and School 


Fema 1 e 


Ma 1 e 


N- 


r ema le 


Ma 1 e 


M 
IN 


Compton 














CACYD 




\ 




38 




b U 


Pasadena, California 














School 70 


/ o 

48 


5 2 


985 




J z 


Q A 
7 D 


School 82 


46 


54 


143 1 . 


5 J 


/. r 

; < 


1 Uo 


-Pro j ect sub total 


47 


53 : 


z41 b 


5 1 


7. o 




Peer Culture Development-, 














Ch icago 












i 


School 1370 


44 




1 1 zU 


j / 


AO 
H J 


1 1 7 


School .1430' 


55 




742 


49 


51 


o c 

95 


School 1820 \ 


'50 


50 


3308 


63 


37 


7 0 


School 3200 N 


53 


'47 


110 


52 


48 


/5 


School 4720 


51 


1 4 9 


149 


50 


50 


26 


School 5070 


53 


/ 47 


77 


64 


36 


22 


School 5550 


46 


/ 54 


94 


53 


47 


30 


School 6010 


" 53' 


47 


287 


49 


51 


43 


■Project subtotal 


50 


50 


5887 


■55 


45 


43 2 


Chicago Board of Education, 














Ch icago 














School 1240 ; 


/ o / 

48 ' / 


52 


ICC 

756 


43 


57 


/ 


School 1340 


52 / 


4 8 


720 


1 UU 


U 


1 
1 


School 2300 


47 < 

48 / 

52,/ . 


53 


177 


29 


7 1 


14 


School 4440 


52 


110 


31 


69 


13 


' School 4550 (control) 


48 


. 124 








School 5090 


^ i 


4 9 




0 o 
J O 


62 


16 


School 5750 


36 


44 


169 


55 


45 


11 


School 5880 


,53 


47 


427 


47 


53 


18 


School 6180 


'0 


40 


138 


67 


33 


15 t 


Project subtotal 


/51 


49 


2813 


45 


55 


95 


Kalamazoo, Michigan 














School 318 




48 


: <6 '.- 


45 


55 


100 


School 327 


46 


54 










Proj ect subtotal 


49 


51 




+ 5 


55 


100 


Note: A dash signifies not 


appl icabl e • 
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Table 6 (continued) 



Gender Self-Identification of Students in Participating Schools 
and of Students Receiving Direct Services, Spring 1982 



Total School 



Directly Served 



City . and School 



% 

Fema 1 e 


I 

Male 


Weighted 
K 


% 

Female 


%' 

Male 


N ■ 


51 


- 49 


• 

333 














32 


68 


34 


56 ■ 


44 


66 


38 


62 


13 




52 


143 


43 


57 


14 


52 •' 


48 


131 


15 


85. 


13 


48 


52 


260 


33 


67 


15. 


52 


48 


291 


18 


82 


11 


55 


45 


87 


47 


53# 


17 


56 - 


44 


413 








52 


48 


233 


50 


50 


8 


54 


46 


326 


22 


78 


18 


. 50 


50 


667 








' 53 


47 


212 








52 


48 


3196 


33 


67 


143 


53 


47. 


137 


59 


41 


92 


51 


49 


384 


59 


41 


189 


46 


"54 


237 


56 


44 


152 


57 


' 43 


526 


57 


43 


293 


5 2 


48 


1269 


57 . 


43 


635 



South Bronx, New York 
School 22 

School 53 (mini unit) 
School 55 
School 63 
" School 64 
' School 82 1 
School 117 
. School 132 
School 145 
. School .147 
School 148 
School 166 
School 229 

Project subtotal 
East Harlem, New York 
Project subtotal 
Puerto Rico 
School 1 
School 2 
. School 3 

Project subtotal 
Charl eston, South 
Carolina (PA THE) . 
School 242 (control) 
School 741 
Schot.1 742 
School 743 

School, 7 51 (control ) 
School' 7 54 
School 755 
School 944 
School 951 

Project subtotal 



47 


53 


468 








54 


46 


423 


47 


53 • 


75 


53 


47 


427 


3L 


69 


52 


44 


56 


402 


48 


52 


66 


65 


35 


323 








50 


50 


444 


' 52 - 


48 


60 


53 


47 


7 34 


47.. 


•53 


64 


49 


51 


• 363 


38 


. 62 


53 


47 


53 


650 


38 


62 


55 


51 : 


49 


4235 


44 


56 


425 



Note: A dash signifies not applicable. 
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Table f» (continued) 

Gender Self-Identif ication of Students in Participating Schools 

and of Students Receiving Direct Services, Spr ing ~1982~~ 
„ h 

Total School * Directly Servejd 



City and School 


% 

Female 


% 

Mai e 


Weighted 
N 


% 

Female 


% 

Male 


N 


; ------ 

# Houston (GIS) 














Project sifbtotal 


— 


— 


— 


52 


48 ' 


v , 61 


Virgin Islands 














Project subtotal 


51 


49 . 


1266 


28 


72 


29 


Hey ward (LCO) - 














Project subtotal 




— 


— 


46 v 


54 


78 


Miami . 








*46 






Project subtotal 




— 




54 


69 


Plymouth, Michigan 














Growth Works 


, — 


— 


— 


23 


77 


31 


^ School 31 


59 


.41 


669 


18 


82 


17 


School 41 


48 


52 


919. 


56 


44 


18 


School 42 


53 


47 


115 


48 


52 


64 


School 43 


49 


51 


110 


38 


62 


'47 


Project subtotal 


- 52 


48 


1837 


39.. 


61 


177 


l«CW *J XZ L o ^ y 














School. 1 ' ... 


44 


56 


192 


25 


75 


• 24 


f -School 2 ' • 


52 


- .48 


1001 


30. 


70 


23 


School 3 


50 - 


50 


316 


47 


• 53 


34 


School 4 


55 


45 


379 


30 ' 


70 


23 


Pro jec t subt o t al 


51 


49 


1888 


35 


65 . 


104 


St. Paul 














School 210 


46 


54 


1209 


48 


52 


27 7 


School 230 




53 


1311. 


0 


100 . 


2 


School 342 


46 


54 


^ 488 


58 


42 


117 


School 352 


48 


52 


357 


56 


44 


55 


Prdject subtotal 


47 


53 


3463 


51 


49 


451 


Total 


50 


50 


29851 









Note: A dash signifies not applicable. 



Projects 



the schools involved differs 
markedly by city and sometimes 
within city. 

The ethnic bxeakdown of persons 
receiving direct services through 
the Alternative Education Program is 
presented in Table 5. This table 
includes all projects providing 
direct services, regardless of the 
location "of those services. (The 
project operating in Compton, for 
example, is included in Table 5 -but 
not Table 4 because it primarily 
devotes its efforts to a group of 
high risk youths directly served by - 
its alternative schot>l.) For the 
most part the ethnicity of youths 
who receive direct services resem- 
bles the ethnic composition of the 
schools served by the projects. 

The gender composition of the 
school populations and of groups 
receiving direct services are 
described in Table 6. As expected, 
*about half of the school populations 
are* male and half female*. There are 
sometimes slightly more males than 
females among direct service reci- 
pients. Males are, of course, more 
likely to have disciplinary diffi- 
culties in school and to engage "in 
delinquent behavior than are 
females, so this slight predominance 
of males is to be expected. 

How Much Delinquent Behavior Occurs ? 

To provide some perspective on 
the youth population involved in the 
Alternative Education Initiative", jLt 
is useful to characterize it "in 
terms of the amount of delinquent 
behavior these youths engage in. 
There is no foolproof wa-y to esti- 
mate the amount ,of delinquent behav- 
ior any^ group engages in (see Chap- 
ter 3), but one method jls to use 
information derived from voluntary 
self-report. Accordingly, Table 7 
shows the proportion of youths 



admitting to have committed each of 
several kinds of delinquent behavior 
in the past year. These tabula- 
tions, which have been statistically 
adjusted to reflect the populations, 
of the schools involved, imply that 
these youths (especially th'e males) 
have committed a large number of 
crimes. Note that the table shows 
only the percentage who admit to 
each crime at least once . Undoubt- 
edly the total number of crimes com- 
mitted is much larger. 

According to Table 7, the popula- 
tions of the public and alternative 
schools involved in the Alternative 
Education Program engage in a sub- 
stantial amount of delinquent behav- 
ior. Of the males, 13% damaged or 
destroyed, school property at least 
once, 17% damaged or destroyed other 
property, 19% carried a concealed 
weapon, 13% were involved in gang* 
fights, and 10% hit Or threatened to 
hit a teacher. The absolute numbers 
of males in these schools who 
engaged in these behaviors are: 
( 2210 vandalized school property, 
2852 vandalized other prope'rty, 3291 
carried a concealed weapon, 3134 
stole or tried to steal something 
worth more than $50, 1035 used 
s trong-arm methods to rob someone. 
Females engage in each of the fore- 
going behaviors much less often than 
males— half as often or less. 

The percentages of males and 
females smoking, drinking and using 
drugs are more nearly equal. Forty- 
six percent of the males and 44% of 
the females report drinking, 23% of 
males and 20% of females report 
using marijuana. 

Only 24% of the males and 36% of 
the females report engaging in none 
of the behaviors listed. A rela- 
tively small percentage of youths 
report engaging in a great variety 
of delinquent behavior: 7% of the 
males and 2% of the femaleswe ported 
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/ Table 7 \ 

IV r c en t age? fT"oT tia 1 e s and Females Reporting \They Committed 
Each of a Variety of Delinquent Behaviors in Past Year" 
and Estimated Number* of Youths Committing, 1982 

. 1 



Behavior 




Mai es 


i 
i 

0 




Fema 1 es 


% 




\ 

n \ 


/, 






Damaged or destroyed school 






n o i n 
zzl U 


0 


.2 


1132 


property 












1112 


Damaged or destroyed other 


16 


.7 


2852 


/ 
0 


.1 


property 








1 


0 
. 0 


TOO 

j 2.2. 


Stolen o-r tried to steal 


7 


.7 


1317 


something worth less than vOU 










- 




Carried a concealed weapon 


1 o 

i y 




q i n i 


5 


.8 


1050 


Been involved in gang fight 




. U 


zzU j 


c 

j 


.2 


936 


Sold marijuana or other drugs 


7 


.9 


1336 


4 


.0 


714 


Hit or threatened to hit. a 


10 


r 

.5 


1 ^ o c 

1 785 




.7 


QC 1 

o5 1 


teacher 














Hit or threatened to hit a 


c c\ 

50 


-4 . 


o51 1 


31 


.5 


v 5618 


student 














Taken "a car without owner's 


Q 
O 




i /. n Q 


3 


.1 


ceo 

J J J 


permission 








1 




t 


Used force or strong ami methods 


0 


. 1 


1 Uj J 


.9 


J JO 


to rob 














Sto'len or tried to steal f 


1 o 

18 


.6 


010/ 
3134 


' 10 


.4 


1 QC. Q 
1 OJ O 


something worth more than $50 














Stolen or tried to steal some- 


1 o 

1 J 


• o 


O 1 QQ 

zl oV 


5.0 


895 


thing from locker or 














elsewhere at school 














Broken or tried to break into a 


7 


.5 


1253 


1 


.7 


309 


building or car 














Smoked cigarettes 


24 


.3 


4062 


33 


.1 


5884 


Consumed alcohol 


45 


.7 


7566 


43 


.6 


7634 


Smoked marijuana 


23 


.4 


3898 


20 


.2 


3586 


Taken other drugs 


7 


.7 


1285 ' 


7 


.5 . 


1323 


Gone to school drunk or high 


12 


.0 


2006 


8 


.7 


1540 


Used inhalants 


6 


.1 


1015 


5 


.3 


935 


None of the above 


24 


.0 


3957 


35 


.8 


6316 


One of the above or 


39 


.9 


6593 


54 


.2 


- 9571 


fewer 














Two of the above or 


43 


.2 


7128 


56 


.8 


10037 


fewer 














Half or more of the above 


6 


.8 


1123 


2 


.2 


389 



Note . Based on weighted tabulations from the Spring, 1982, School 
Action Effectiveness Study survey. The total weighted N is 19167 
males and 19274 females. Percentages exclude non-respondents. N's 
shown in the table are the estimated number. of persons performing 
each type of behavior in past year but do not include survey or item 
non-respondents. 
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engaging in half or more of the 
behaviors listed in the past year. 

Some Consequences of Vict itnizat ion 

Most work on crime neglects the 
victim, focusing exclusive attention 
on the offender. Yet it is the vic- 
tim of crime who most directly 
experiences the impact of the 
offense, and the recent report of 
the President's Task Force on Vic- 
tims of Crime (1982) begins the task 
of focusing greater attention on the 
victim. 

Reducing victimization is an 
important goal of the Alternative 
Education Program, and results pre- 
sented in Chapter 5 discuss the 
achievement in this area through the 
Program's second year. Data col- 
lected as part of the. evaluation 
illustrate how crime may affect the ^ 
victim. Students who report more 
extensive victimization in surveys 
conductedas part of the School 
Action Effectiveness Study are sig- 
nificantly more alienated (feel they 
are less connected to the social 
order), like school; significantly 
less, and have significantly lower 
self-esteem. When the psychological 
health of students is studied over 
time* we find evidence of negative 
effects of victimization on aliena- 
tion and the amount of effort 
expended at school work for female 
students. (A technical account of 
our preliminary correlational 
research in this area may be found 
in Gottfredson (1983a). 

Much remains to be done in the 
area' of documenting and measuring 
the effects of vie t imization on the 
victim. We interpret these prelimi- 
nary results as suggesting negative 
effects that interfere with the sea- 
deraic work of the victim as well as 
having serious direct harmful psy- 
chological effects, especially for 
female students. 



In short, delinquent behavior and 
victimization are without question 
serious problems in the public and 
alternative schools involved in the 
Alternative Education Program. 

Who Engages in Delinquent Behavior ? 

Naturally, not all youths engage 
in .delinquent behavior to the same 
degree. Table 8 shows correlations 
between the number of different 
kinds of .delinquent behavior admit- 
ted and various personal character- 
istics. The results shown in Table* 
8 generally accord with the results 
of previous research, and imply that 
the youths who engage in more delin- 
quent behavior are characterized by: 

o Weak attachment to parents* 

o Associaticn with delinquent peers. 

o Al*ieVation, or a feeling of not 
being connected to the social 
order. 

o Weak attachment or dislike for 
school. 

o Lack of belief in the validity of 
. rules . 

o Low self-esteem or a delinquent 
self-concept. 

o Premature and rebellious expres- 
sions of autonomy. 

o Little effort expended at school- 
work. 

o Truancy. 



Youths engaging in much delinquent 
1 behavior are not much different in 
terms of parental education (a meas- 
ure of socioeconomic status) than 
those engaging in little delinquent 
behavior. The more delinquent 
youths are punished more in school 
sknd also are victimized somewhat 
S more than other students in school* 
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Table 8 



Correlations between Selected Personal Characteristics 
and Variety of Delinquent Behavior Reported 





Males 


TT Civn n 1 oe 
r t llld L U o 


characteristic 


r 


N 


r N 


Parental Education 


.06 


328 


.12* 448 


Attachment Lo Parents 


-.26* 


398 


-.34*^550 


Negative Peer Influence 


.52* 


446 


.42 614 


Al iena tion 


.19* 


399 


.25* 564 


Attachment to School 


-.36* 


427 


-.43* 600 


Belief in 'Rules ° 


-.35* 


386 , 


-.26* 549 


Positive Sel f -Concept 


-.22* 


361 


-.28* 520 


Rebellious Autonomy 


.22* 


•307 


.32* 460 


School Effort 


-.31* 


387 


-.32* 529 


School Nonattendance 


.30* 


459 


.27* 618 


School Punishments 


.23* 


437 


.33* 605 


Victimization 


.16* 


432 


.23* 605 



Note , These correlations are calculated using a random 1 , 
half of the students who completed SAES surveys in the 
Spring of 1981 that included the self-report delin- 
quency measure. Correlations are computed on this sub- 
sample to save the cost of processing a much larger < 
file; the pattern of results would be substantially the 
same were calculation performed on the entire sample. 

*£ < .01. . 
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The foregoing results are not new 
to researchers in the delinquency 
area. They once again ' suggest the 
appropriateness of testing interven- 
tions to prevent delinquency using 
al temative education approaches . 
Interventions in school to alter 
structural relations in the environ- 
ment or to enhance the ability of 
youths to adapt to schooling are 
suggested by these data. Activities 
by educa t ors tc de crease 1 the nega- 
tive influence of delinquent peers , 
to create greater feelings of con- 
nectedness to the social order of 
the school, to incr ease r at tachment 



to or liking for school, to foster 
belief in the validity of rules, and 
to develop (or at least not ravage) 
the students' self concepts may very 
wel 1 reduce youth cr ime. 



In the next chapter we begin to 
address two questions: "Are the 
projects participating in the Alter 
native Education Program providing 
evidence that they are preventing 
del inquency ?" And, "Are these pro 
ects providing ev idence that they 
are influencing the known concomi- 
tants of (and presumed risk factors 
f or ) de 1 inque n t be hav ior ? 11 
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The Environmental Effect of the Alternative Education Prqgram 
* and Population Results for Delinquent Behavior 



The Program Announcement for the 
Program in Delinquency Prevention 
through Alternative Education 
(OJJDP, 1980) makes clear tnat the 
Office aimed to demonstrate delin- 
quency prevent ion' programs that 
created structural changes in the 
organization of schooling to bring 
about changes in the behavior and 
psychosocial development of students 
and teachers in those schools. In 
other words, 'the Program aims at 
de li nquencv prevent ion through 
changes in school climate and 
changes in the attitudes and behav - 
iors of students an-d teachers in the 
schools. These outcomes involve the 
entire populations of the schools 
involved. Outcome measures are epi- 
demiological indices of behavior and 
personal characteristics for schools 
and measures of school environments. 
The present chapter reports on pro- 
gress\in these areas. 

Overview of the Results Sought by 
^ the Program 

i 

The results • sought by the OJJDP 
are recounted in Chapter 1. Chapter 
3 describes in detail some of the 
measures we have developed to -meas- 
ure these desired outcopnfes. The 
following paragraphs collate meas- 
ures with results sought. 

Measures of Program Goa ls 

Reduce ^ delinquent behavior in and 
'arourvd sc hools . i This goal is of 
central importance and is measured 
in several ways. (a) A Self-Re- 
ported Delinquent Behavior scale and 
two scales composed of subsets of 
items from this scale: Self-Re- 
ported Drug Involvement and Self-Re- 
ported Serious Del inquent Behavior. 
The first of these subscales con- 



tains only items related to 
substance use and the second is res- 
tricted to the illegal behaviors of 
greatest seriousness (excluding 
drug-related items). (b) A Student 
Victimization scale, ."-(c) Student* 
reports of Gangs in School , 

(d) Student reports of Safety. 

(e) Student reports of Community 
Crime, (f) Teacher reports of* 
Safety, (g) Teacher reports of Vic- , 
t imization, '(h) Teacher reports of 
Classroom Disruption. Additional 
measures of delinquent behavior wfere 
collected from official records for 

a number of projects, but they were 
not.collected in parallel ways from 
project to project;,, and no results 
based on of f icial records are, 
reported in this chapter. Some 
results based on official records 
are included in Part II of this 
report . - 

Decrease suspension , This goal 
is measured in a parallel way for 
all projects through students' 
reports of suspension from school. 
The definition of "suspension" dif- 
fers greatly from project to pf oject 
(and school system to school sys- 
um) • School systems ofteriadopt 
definitional changes to alter the 
appearance of high suspension rates, 
Accordingly, although information 
was collected from school recoiSds on 
suspension, that information may not 
be regarded as parallel across proj- 
ects. Those non-uniform data will 
\>e used els.ewhere, but are not 
reported here. 

Increase attendance , ' This goal 
is measured in a parallel way for 
all projects through students' 
reports of School Nonat tendance . 
The definition of "attendance" and 
the methods used to maintain these 
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data differ greatly from, school 
system to .school system. Accord- 
ingly, information collected from 
school records is put to use 'else- 
where in examining project compo- 
nents within school systems hut it 
is not reported here* * , • 

L n c_r e as e near e mi c s u cc e s s . Th i s 
goal is me a s,u red in <* i pa r a I lei wa y 
for all projects through students" 
reports of their school grades. 
School systems differ in their grad- 
ing practices and reporting formats, 
and they di f f or in the s tan da rdi zed 
achievement tests administered and 
their test administration practices* 
Accordingly analyses of individual 
project grade and Vjggrst score infor- 
mation derived from school records 
are presented elsewhere. 

Im prove tr ansi tion to work and 
post-secondary educatio n . Ou r uni- 
form measure of- this goal is stu- 
dents' educational expectat i ons . 
Extensive research shows this to be 
a useful predictor of subsequent 
career and educational attainment. 
Educational expectations are there- 
fore an excellent proxy, for actual 
follow-ups of career and educational 
behavior. Those data, which would 
be costly to collect and which would 
require waits of several years are t 
not available now. 

Mea sures of Pr ogra m Objectives 

Fair and consistent school disci - 
p 1 ine . Two scales measure this 
objective: (a)- Rule Clarity , and 
(b) Fairness of Rules. 

. Youth, parent and community pa r- 
ticipation in school decision making 
and reduced student al ienation . 
This objective is multi-faceted, and 
is measured by the fol lowing: 
(a ) student repor t s of Student 
Influence", (b) teacher reports of 



Parent an d Comiuu n i t y Influence, 
( c ) teacher reports of St udeni 
1 nf 1 uence , ( d ) a student Al i enat i,on 
S ca 1 e . 

* Prec lud e label ing effect s . 
Labeling theory hypothesizes that 
when people are treated as delin- 
*■ quent , stupid , or bad that they come 
to see themselves as delinquent, 
stupid or bad. That is they develop 
negative sel'f-concepts which contri- 
bute to future delinquent, stupid, 
or bad behavior (called "secondary 
deviance 11 ). Consequently this , 
objective is measured by the Posi-< 
t ive Sel f -Concept Scale ( s tudent s ) 
and the Low Expectations Scale 
(teachers ) . w ^ 

jlco.vulo. «i lea rnin g struc ture real- 
istically tailored to promote edu ca- 
tional and soc ia 1 deve lopment . This 
multi-faceted objective includes 
objectives related to psychosocial 
development, educational develop- 
ment, and educational structural 
arrangements. Educational develop- 
ment is redundant ~wi th one of the 
Program's g6als. The following list 
are the measures of the psychosocial 
and structural objectives: 

(a ) student Rebel lious Autonomy , 

( b) student Practical Knowledge , 

(c) student Interpersonal Compe- 
tency, (d) Parental Emphasis on Edu- 
cation, ( e ) s tudent repor ts of 
School Punishment, (f) student 
reports of School Rewards, 

(g) teacher report^ of In di vidua 1- 
y ized Instruction, (h) teacher 

reports Qf the Use of Grades as a * 
Sanction, (i) student reports .of 
Individual ized Instruction, 
( j ) teacher reports of the use of 
Type A Sanctions, (k) teacher 
reports of the, use of Type B Sanc- 
tions, (1) teacher Non-Authoritarian 
Attitudes, and (m) teacher reports 
oi Interaction With Students. § 
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'I' hen r e t i c a 1 I nippjrJL a \\i Ou t c pme i ; 

In addition to the objectives 
explicitly mentioned in the OJJD1' 
Program Announcement, theory and 
research in do 1 inquency prevent ion 
and organizational change and the 
theories of action underlying one or 
more of the 17 prevention projects 
suggest several other important out- 
comes.- It is important ^that an 
e VyA 1 ua t i o n of a rte 1 i nq u e n c y ( p r e v e n- 
tion program attend to these impor- 
tant intermediary outcomes because 
they should help explain the -success- 
or failure of a project. These 
additional outcomes fall into two 
groups: ou t comes * re la ted tjo organi- 
» national health that may be related 
to the ability of the organization 
to implement strong interventions , 
and outcomes known or believed to be 
important risk factors for delin- 
quent behav ior . 

Organ»i z at ional heal th . We r e por t 
on the following f i vef mensur es of 
organizational health: (a) Student 
reports of school Planning and 
Action, (b) teacher reports, of 
school .Planning and "Action, 
(c) teacher reports of Smooth School 
Administration, (d). Teaching Sta,ff 
Commitment, (e) Teaching Staff • 
Morale, .(f) teacher Job Satisfac- 
tion, and (g> teacher Professional 
Development. * 4 

Delinquency* risk^f actors . Th e 
following five additional measures 
of risk factors for delinquent 
behavior are important : : 

(a) Attachment to Parents, 

(b) Attachment to School, (c) Belief 
in Rules, (d) Negative Peer Influ- 
ence, (e) Disrespect for Students. 

Methods 

Results presented in this chapter 
are based on surveys students and 
teachers conducted in the Spr ing of 
1981 and 1982. We requested all 
participating schools to survey al'l 



ttil I ~t hue teach its; who teach at 
least, one student in grades tax 
through twelve in both years, and we 
requested all participating schools, 
to cooperate with the assessment, of 
a probability sample of students 
.selected to make possible estimates 
for the school's population of 
schools. Tl lis r e q u e s t wa s ni e t i n 
most ca se s . 1 

In assessing changes in measures 
of Program goals, objectives, and 
•additional outcomes over time, three 
different methods were used. These 
methods are described in the follow- 
ing paragraphs. 

Simple Box Score s 

Firs't , simple "box scores" are 
used to obtain an overall picture of 
t he pa t tern of progress towards 
goals and objectives for the Program 
as a whole. In tallying these 
scores, we compared* the , school- com- 
positional and psychosocial climate 



f.. The New T ersey and Jazzmobile 
projects did not survey teachers in 
1981 and there were irregularities 
in the administration of the 'Student 
surveys in. those projects. The 
Miami project was not- yet running' 
its alternative school in 1981 . The 
Milwaukee project was not operating 
in schools at . the time of either 
survey. The Plymouth project did 
not use a probabil ity student sam- 
pling procedure in 1982. Shor t 
forms o^ the student questionnaire 
were made available to the Compton 
and Virgin Is lands pr ojects in 1981 
where difficulties with reading lev- 
els/ were anticipated. Items werei^ 
censored from the 1981' questionnaire 
by the St. Paul, Plymouth, Chicago 
B oard of Educa t ion (and therefore 
PCD), Pasadena, Harlem, New Jersey, 
and Char lest on projects (listed in 
decreasing order of number of items 
censored). Items were censored from 

SO - > • 
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tiic;i!iHi i'. 1 ) lot oath s<ho<>! according 
to assos suiout s ni.ttli* it; tin- Spi ing o! 
I 9H 1 and aga in in t lu ^>pi i ng of 

Any given school'could 
improve on a measure, legions oi go t 
worm* on the mrasiii'r, oi stay tho 
same. In making these tall in* wo 
excluded school s which did not 
admin i st ft the relevant po r t i on m oi 
t lu* Sc hool Art j on Hi Iri't (vtMit'i.h Sot 
voy for oi ther year, schools for 
which the sampling stiatogy changed 
in ma jor ways from one year t ci tho 
ui'Xt , and sahools in which the sur~ 
voy response rates for thr two years 
differed hy more* than 2*)!*, . Several 
school systems or project directors 
consorod it emu from the survey in 
1981, and two projects censored 
items' from tho survey iu J982. For 
a variety of reasons, we were unable 
tf o prevent the sampl in>i /st rategy 
from differing in somo. schools in 
New Jersey, the Bronx , 'Pi y mouth , and 
PCD from one year to the next (see • 
footnote 1). Finally, poor survey 
administration in one or another 
year made measures non-comparable 
for the two years in some schools in 
CUE and the Bronx, as well as in the 
LCO and Houston projects. 
/ • 

The sign test (Siegel, 1956) was 
use*! to estimate the probability 
that the number of positive .or nega- 
tive changes observed would arise by 
chance were there no true difference 
■?from year to year. 

School-tJy-School E xaminkt ion 

The detailed results of the cli- 
mate assessments for each school 
involved in the Program were also 
examined. 1 r J 

^ 

the 1982 questionnaire by the Miami 
and St.- Paul projects. No items are 
being censored from the 1983 ques- 
t i.onna i re ! 



S c Uo*» 1 compos 1 1 | on • Fot mcamn es 
o| m liool com pot* it tonal el imat o 
based oy .st nd out repor t s , t * st at i t»- 
tics for the ditference brtween 1 l >81 
and 1 9B2 me an n * on me art ur o s oi st u 
d on t eh a i ac t o i i s t ic w we i e comput ed 
based on the observed moans and 
standard deviat ions tor each school 
for each year. For those school 
j ompos i t i en uioasurvs , di t \ ei « noes 
m ay be rega rd ed as do pendah 1 e 1 1 tho 
t -at at i st i c exceeds 1 .96 . 

** c A°9j _ P H Y c l^XBQC.ia l_c ljuiate • Fo r 
comparisons of 1981 and 1982 psycho- 
social clinufte measures, a different 
kind of "t -fltati fit ic" was computed. 
This statistic uses information • 
about the psychometric properties of 
the measures to compare each differ- 
ence in scores to an index of the . 
margin of er ror for that di f f erence .' 
Specifically, the M t-statistic" 
reported is the ratio of the differ- 
ence between 1982 and 1981 scores to 
the standard error of measurement of 
the 19$2 scores. (In calculating 
the standard error of measurement, 
the St. Paul schools" data were not 
inc lulled, because these data became 
available much later than all the 
rest of the data.) As a rule of 
thumb, differences that exceed twice 
the standard error of measurement 
mav be regarded as dependable. That 
is, differences for which the^ 
t# jt— statistic shown in the tables is 
equal to or greater than 2.0 may be 
regarded as dependable. 

Resu Its 

Program Box^Scores 

Gpa Is . An overview of the number 
of schools that improve^ or 
regressed on each Program goal is 
provided by Table 1; The first 
column in the table shows the number 
of schools that improved on each 
measure, the second column shows the 
number of schools that regressed 
(got worse), and the third column m 
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Numbe t ot A 1 1 r run t i vo Kchu-a t. i on Program School k 
that Improved and Ke#roHi;ed from 1981 to 1982 oiv 
Retail t« Sought : Goal 8 



Measure 



Number of Al ternnt ive 
Kdu cat i on Sites 

Improved Regressed No Da ta 



Decrease Del iuquent Behavior 
In and Around School 



■ Luden t s ' 


Total Del inquency 


11 , 


8 ' 


19 


St ii den ts' 


Drug Uac 


11 


M 


19 


Students' 


Ser lous Del inquency 


11 


22 


S tuden ts' 


Victimization 


17 


16 


5 


Students' 


Gangs in School 


14 


10 


14 


Students' 


Safety 


18* 


* i 


16 


Studen ts' 


Repor t s of Communi ty Cr ime 


10 


15 


13 


Teachers ' 


Safety 


21* 


4 


. 13 


Teachers ' 


Vict im i at ion 


22*- 


5 


1 1 


C lassroom 


Disrupt i on a 


14 ' 


13 ' 


10 



Decrease Suspensions u 

Students' Suspensions * 3. 5 

# 

Increase Attendance 

Students' School At t endance 2 0 

Increase Academic Success 

Students' Grades 14 

Improve Transition to Work and ( * 

Post-secondary Education 

Students' Educational Expectations 21 



16 



13 



19 



12 



Note . TWenty-seven Alternative Education program schqols are excluded 
from this table because of significant differences in the-sampl ing 
from 1981 to' 1982. . , 



* p<.01 

a 0ne school had no change. 



Table 2 



Number of Alternative Education- Program Schools 
;hat Improved and Regressed* from 1981 tc 1982 on 
Results Sought: Objectives 



Measure 



^ 'Number of Alternative 
v Education Sites 

Improved Regressed No Da;., 



Making School Discipline Fair and Consistent 
While Providing for Due Process 

Students' Reports of Clarity - of --Rul es 
Students' Reports of Fairness of Ijtules 

Increasing Youth, Parent and Community Agency 
Participation in School Decision Making to 
Reduce Student Alienation 

Students' Reports of Student Influence 
Teachers' Reports of Parent and Community/ 
"Influence 

Teachers' Reports of Student Influence 
otudents' Alienation- 
Preclude Labeling Effects 

Students' Positive Sel f-Coffcepir s 
Teachers' Low Expectations 

Provide a Learning Structure Tailored to 
Realistic Levels to- Promote Educational 
and Social Development 

Students' Rebellious Autonomy 
Studen ts' Practical Knowledge 
Students' Interpersonal Competency , 
Students' Reports of Parental Emphasis 

ori Education 
Students' Self -repor ted School Punishments 
Students' Self-reported School Rewards 
Teachers' Reports of Individualized 

Instruction 
Teachers' Reported Use of Grades 

as Sanction 2 
Students' Reports of Individualized 

Instruction * . 



16 
12 



17 

21 



9 


1 8 


1 i 


I / 


i i 

i i 




15 


13 


i r 


23* 


10 


IT. 

.y 








2 8** 


5 




17 


1 1 


1 c 














23** 


A 


1 1 


11 


22 


s 


lb 


1 1 


1 •' 


2 


1 2** 


24 


17 


16 




19 


14 


b 


10 


18 


10 


12 


1 5 


1 0 


10 


23* 


5 


it schools 


are exel 


ude d 


th e sampl 


ing frgrm 


1981 



th is tabl e . because 
1982. 



gn: 



'One school, had no change, 



p<„05 



p<.01 
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shows the number -ols excluded 

from the t.a I 1 y c! an avail- 

ablity of inform r one year 

or the other, Th ley shows that 

for nine of the ten measures of 
delinquency in and around .school s 
the measures shov less delinquency 
in 1982 than in 1981. The differ- 
ences for measures of school Safety 
and Teacher Victimization reach sta- 
tistical significance. .The number 
of schools increasing in safety is 
stat) st ical ly significant according 
to both the student and teacher 
measures. 

' Evidence in Table 1 about the 
other goals sought is not clearcut, 
although the* number of schools with 
higher Attendance and students with 
high Educational . Expect ations is 
r.bnsigni f icantly greater than the 
number of /schools which declined on 
these measures. 

Ob lec t ive s . Box scores for Pro- 
gram objectives that parallel the 
results for goals are shown ir Table 
1. . .The evidence from this table 
suggests that the objective of 
increased fairness and consistency 
of the school rules is not generally 
being met. Although not signifi- 
cant, the pattern of results is chat 
mo r e s c h o o 1 s decreased on Fairness 
of Rules than increased. The number 
of schools that increased on the two 
measures of Student Influence and 
t h e me a sure of Comnuj ri i t y Influence 
i s no t significantly d i f f e rent f r cm 
t h e n umb e r that regressed. Student 
A I i ena t i o n , ho w e v e r , decreased in 
s i g n i i i c a n t; 1 y more' school « than i t 
i ih" i" i rase d 

N i ? a r 1 y .six t i m e s a s m a n y school s 
i m p r • o v e d a s* re g r e s s ^ d o n I i \ e n e a s u r e 
of students' Positive So 1 f -Concept . 
Tins pattern is signifi ant. Teach- 
ers" expectations for students* 
i n iTf a a e d i. t: mo r e " s c h o o 1 s than.it ■ 
cl f : c r o a s e d , b u t this pa 1 1 e r n is not 
s t a t i s t i c a I 1 y s i gn i f i ca n t . 



Environments and Delinquency 

Changes in student psychosocial 
development as measured by Rebel 1 i~ 
ous Autonomy and Interpersonal Com- 
petency. are favorable: 'Higher' for 
1 nt erpresonal Competency and lower 
for Rebellious Autonomy in more 
schools in 1982 than in 1981. The 
number of improved schools is si gn i- 
f icant for Rebel 1. ious Auton om y . By 
and large, the schools in the Pro- 
gram regr.essed on measures of the 
presence of learning structures pre- 
sumed to promote social development. 
In particular, students' reports of 
Individualized Instruction was lower 
in more schools in 1982 than it was 
in 1981 for more schools than would 
be expected by chance * 
* 

Add it iona 1 outcomes « Teacher 
Commitment and Morale increased in 
more schools than it decreased, as 
shown in Table 3. For Morale this 
pattern is significant. No .'distinct 
pattern of change was observed for 
any other measure of organizational 
heal th . 

Table 3 also shows that more 
schools improved than regressed on 
each of the five theoretical risk 
factors for delinquent behavior, 
a 1 1 hough Lnone of the . pat terns 
observed fo\ these changes were sta- 
t istically s ngn i f i c a n t . 

Sc hoo 1 -by -a. cho p 1 Summary 

The foregoing overal 1 tal 1 ies 
ignore changes from one* year to the 
next for specific projects and 
school s . In the paragraphs that 
fa! 1 ow ? a de t a i 1 e d s ummary of th ese 
y, to-year changes is provided. 
In this section 1 , only changes that 
are no;.?.n«)ily statistically signifi- 
cant: described. A complete 
account];;; of every school's results 
for all measures is provided in 
Appendix D. ■ In preparing the tables 
presented in this section, a great ' 
many significance tests were per- 
-formed. When many such tests are 



Table 3 



Number of Alternative Education 


Program Schools 




that Improved and Regressed from 


1981 to 1982 


on 




Results Sought: Learnin-g Structures and Additional 


Outcomes 






Number rf 


Al ternative 




Education Sites- 




iiea surt' 


Improved Regressed No 


_ 

Da t a 


19oJ to 19o2 Change on Measures oi 








Learning Structures - ; 








Teachers" use ■>£ Type A Sanction.; 


16 


13 


9 


I eache use ot lype b banc: ions 


13 


15 


10 


Teachers' Non-Author itar ian Attitudes 


16 


1 2 


10 


Teachers' Interaction with Students 


13 


16 


9 


1981 to 1982 Change on Measures Of 








Organizational Health 


12 


15 


11 


Students' Rc; ports of Planning and Action 


T eachers' Reports of Planning and Action 


13 


15 


1 o 


Teachers' Reports of Smooth Sri ool 






TO 


Administration 


15 


13 


Teachers' Commitment 


17 


1 1 


10 


Teachers' Morale 


22* 


6 


10 


Teachers' Job Satisfaction 


16 


13 




Teachers' Professional Development 


,12 


17 


9 



1981 to 1982 School Changes on Additional 
Theoretical Predictors of Delinquency 
Students' Attachment to Parents 
Students' Attachment to frchool 
Students' Belief in Rules 
Students' Negative Peer Influence 
Students' Reports of Disrespect for - 
Students 



14 
17 
21 
16 
16 



13 



11 

5 
3 
9 
10 



Note . Twenty-seven Alternative Education 'program schools are excluded from 

this table because 'of significant differences in the sampling from/1981 to 
1982, 

* p<.01 
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H igh School ) bo th 1 tier eased s i gn i 1 i - 
cantly in Self-Reported Delinquency 
(and the Drug Involvement sub- 
s t:j 1 e ) . Fina 1 1 y , one of the Bronx 
Elementary School s (No- 63 ) 
increased significantly in Self -Re- 
ported Drug Involvement. 



Environments and Del inquency 

performed,' some of them are almost 
;;:;rrly "significant' 1 by chance 
alone. For this reason, signili- 
c a n c e t e s t s s h o u 1 d be v e g a r d e d a a 
nominal, and interpreted with' can- 
t ion . * ■ » ■ 

I n s iinun a i i z i n g t h e /? <; h o o 1 - b y - 
school results, we will not belabor 
the reader with a line-by-line 
account of the tables. Hie moti-' 
vated reader can sift through the 
details without our guidance.* 
Instead, we r>hal 1 high 1 igh t selected^ 
results that appear to us to suggest 
meaningful patterns. 

Del inquen t behavi or . At least 
one school in Charleston, Virgin - 
Islands, and Compton projects showed 
a significant decrease on one or 
more measures of self -reported 
delinquency. These results are pre- 
sented in Table 4. Specifically, 
St. Johns High School in Charleston 
and Elena Christian Junior High / 
School in 4 the Virgin Islands 'had 
significantly lower mean scores on. 
the Self-Reported Delinquency Scale • 
(and on the Drug Involvement sub- 
scale) in 1982' than ..in 1981. Brown 
High School in Charleston and the 
Alternative School in Compton had^ 
s i gn i f i c-a n 1 1 y low of s c o r e s o n . t h e 
Serious 'Del inquent Behavior sub- 
'scale. Plymouth Central Middle 
School "and the. cont rol school for 
the Kalamazoo project (South Junior 



2. In all, 1 ,3 7 7 tests were per- 
{ o nn r- d . ■ I f e a c h of t h e so test s we r e 
independent, 69 "significant 11 c! i f — 
* i e r en c e s at t h c . 0 5 1 e v e 1 wo u 1 d be 
expected by chance" al one , and 14 
wo u 1 d* be e x p e c t ed by chance alone at 
the .01. ire v el. Differ e n c e s a 1 1 r i bu - 
t a hie t o c h an c c should be r o u gh 1 y 
equa l 1 y -div ided between positive and 
negative outcomes. We observed 179 
differences that reached " signifi- 
cance' 1 at the .0 r > level , ■ 102 . posi- 
t i y e a e d 7 7 negative. 



Othe r m e a s u re s of delinquency, in 
and arou nd sch ools. On other meas- 
ures of delinquency in and around 
school s , Charleston f Puerto Rico , 
Pasadena, and Plymouth stand oat as 
projects with most significant 
changes from 1981 to 1982 with some 
Charleston, Pasadena, and Puerto 
Rico school s showing de creases in 

''the other measures of jel inquent 
behavior in and around n-hcols, or 
increases in school Saf ety, and a 
Plymouth school/showing the opposite 
pattern (see Table 4). Table 4 also 
shows that of the schools showing 
s ign i f ica n t. eh ange s in th e various 
measures of delinquency, there were 
more t h an ' twice r s many instances of 

- s ig n i. f i*c a n t i r ■ r. : ov em e n t as de c 1 i r.g 
(27 instances of improvement^ and 12 
of deel ine) * 

Suspensions . Results for suspen- 
sions are shown in Table 5 . Hie . 
tabl.e shows that in seven schools 
the number of suspensions reported 
by students decreased significantly 
and in two schools the number of 
suspensions increased significantly. 
Suspensions decreased in at least 
one school in the Charleston , Puerto 
Rico, Chicago Board of Education, 
and Plymouth, projects; sus pens ions 
increased significantly in one Comp- 
ton and St. Paul school. / 

Academic a nd career outcomes . 
Table 6 shows significant decreases 
in Stf-1 f -repor ted grades in seven 
schools. Table 7 shows that only 
two schools changed significantly in 
the- level of educational expecta- 
tion s - - b v ) t h i n c r e a s e d . 



Table 4 



1981 to 1982 School Cham^: on Alternative Education Goal: 
Decrease Delinquent ^vhavior In and Around School 



Project 
School 


and 


Scale Score 


t Degrees of 


1981 1982 


statistic freedom 




Measure ■ 


Students' Sel f-reported 


Delinquency — Total 



V.a 1 amazoo 

South JHS ( 327 )( control) 



14 .20 



3.11 



423 



Charl eston 

St. John's HS (951) 



12 .10 



-2.05 



549 



Virgin Islands 

Ele.ia Christian JHS 

Plymouth 

Central MS (41) 



.09 .06 
.14 .22 



-2.92 
' 2 .66 



440 



212 



Measure: S' . nts' Self-reported Dr\ig Use 



Kalamazoo 

'South JHS ( 327)(control ) 



17 .27 



3.05 



428 



Bronx 
63 

Cbarl eston 

St. John's HS (951) 



.05 .16 



,24 .19 



3. 



-2.2.7 



193 



5 57 



Virgin Islands 

Elena Christian JHS 



11 .07 



-2.81 



445 



Plymouth 

Central MS (41) 



17 .32 



3.48 



216 



Measure: Students' Self-reported Serious Delinquency 

s ■ : 



Compton Action Center 
CACYD 



26 - .15 



Charleston 

Brown HS (754) ' .10 .07 



•2.22 



-2.01 



78 



573 



87 
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Tabic 4 (continued) 



Project and Scale Score t Degrees of 

School • 1981 1982 statistic freedom 



Measure: Students' 


Self 


•reported 


Victimization 




Constitution.'! Rights **• 
Foundat ion 
Elliot .JHS(70) 


.20 


.16 


-1.99 


573 


Kalamazoo 

South, JHS ( 327) (control ) 


.13 


-.21 


3.79 


420 


Chicago Board of Education 
Bowen HS ( 1240) 
LeMoyne El (4440) 
Bontemps El (5750) 


.09 
.28 
.15 


.05 
.17 
.11 


-2.68 
-3.65 
-2.27 ' 


284 
185 

i 307 

i 


Puerto Rico 

Santiago Gonzales (1) 


.14 


.07 


-5.31 


745 


Charleston 

Burke HS -( 755) 


.15 


. 9 


-4.01 


666 


Plymouth 

Central MS (41) 


.12 


.19 


2.22 


217' 


St. Paul 

Johnson 02.30) 
Witt hington( 352) 


.04 
.10 


. .07 
.15 


2.32 
• 2.80 


418 
311 


Measure: Students' 


Self- 


r epor t ed 


Gangs in School 




Charleston 

Brown HS ( 7 54) 


.49 


. 7 4 


2.07 




Measu.'e: Students'. 


Sel f~ 


reported 


Community Crime 




Virgin Islands 

Elena Christian JHS 


.40 


.2 2 


-2.06 
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Table 4 (continued ) 



Project and 


Scale Score * 


t 


Degrees of 


School 


1981 1982 


statistic 


freedom 


Measure: Teachers' 


Vict imization 






Puerto "Rico 

Santiago Gonzales JHS 


.14 .08 


.-1.97 


i 

34 


Constitutional Rights Fndn. 
Muir H? ( 82) 


.10 . 1 U 


0" 0 n 
— L . L O 


1 si 


Chicago board ol Education 
Boven HS (1240) 


.23 .16 


-1.96 


84 


Measure : Classroom 


Disruption 




- *• 


Constitutional Rights Fndn. 
Elliot JHS (70) 


2.66 2.38 


-2.14 


79 


Peer Culture Development 
* Lake View HS (1430) 


2.10 1.82 


-2.26 


65 


Puerto Rico 
Dr . Aguayo HS 


2.31 1.65 


-3.25 


57 
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Table 4 (continued) 



Project and 
School 


Scale 


Score 


t 


Degrees of 


1981 


1982 


statistic 


f reedom 


Measure: 


Students' Sel f-re 


ported Saf ety 




Bronx 


.57 


.72 


5.65 




Jazzmobile 
88 


,73 


.79 


2.45 


— 


Char 1 es ton 

Burke HS (755) 


. / o 


.82 


2.21 


— 


Measure: Teachers' 


Safety , 




Constitutional Rights 
Founda t i on 
Elliot JHS (70) 


3,-19 


3.60 


2.77 


— 


.Kal amazoo 

Mil wood JHS (318) 


3 .46 


3.7 5 


2.01 




• 

-Puerto Rico 

Santiago Gonzales JHS" 
Dr . Aguayo RS ( 3) 


(i) 3.52 
2 .81 


J. 17 

3-9? 


-2.35 v 
7 .31 ' 




Charl eston 

Court enay MS (741) 
A.B. Rhett MS ( 742) 


3.90 
3.35 


4.24 
3.67 


2.28 
2.17 




Plyinon; h 
, Cent : il MS (41) 


3.78 


3.38 


-2.72 





Note. Oni\ thv.o. schools where thv change from 1981 to 1982 is regarded as depen- 
dable are included on this table. Reports of change on teacher survey measures 
are exclude': from this table when the number of. tMcher surveys on which the 1982 
mean is based, is fewer th;:i? * i- t.-s ta t i s t i ce f or composi t ional measures are ■ 
based on the means and st.au dard deviations for each school. For psychosocial cli- 
mate meases, the "t -statistic 1 !* is. the ratio of the difference between 1982 anck^ 
1981 scores to the standard error of measurement of the 1982 scores. As a rule of 
thumb/ psychosocial climate measure differences that are twice the standard error 
of measurement may be regarded as dependable. • Dashes in the column for degrees of 
freedom indicate that the measure is a psychosocial climate measure. 



Table 5 



1981 to 1987 School Change* cm* Al ternat ive Education Coal: 

Decrease Sitapom; i ons 



Project and Sca le Sc ore t Degrees of 

School » 1981 1982 statistic freedom 



Measure : Students " Sel f -report ed Suspensions 



Com p ton Action Center 
CACYD 

Chicago Board of Educ 
LfiMoyne El (4440) 

Puerto Rico 

Santiago Gonzales J 

Charleston 

A.B. Rhett MS (742) 
Brown HS (754) 
Burke, HS (755) 

Plymouth 

Growth Works ( 1 ) 
Last MS (31) 

St. Paul 

Washington MS < 352) 

Note . Only those schools where the change from 1981 to 1982 is regarded as depen- 
dable are included on this table. Reports of change on teaefcev survey measures 
are excluded from this table when the number of teacher surveys on which the 1982 
mean is based, is fewer than 11. t-statistics for compositional measures are 
based on the means, and standard .deviations for each schodl. For. psychosocial cli- 
mate measures, the "t-stati s tic M is the ratio of the difference between 1982 and 
1981 stores to the standard error of measurement of the 19*82 scores. As a rule of 
thumb, psychosocial climate measure differences- that ^re twice/ the c standard error 
of measurement ro.iy b,e' regarded as dependable. , Dashes fti^ the column for degrees of 
freedom indicate that the measure is a psychosocial climate mensare . 



15 ■ .34 



-2.02 



92 



a t ] on 



HS Cl > 



.32 .18 



.22 .13 



•2.27 



-3.23 



185 
743 



.21 .13 
.49 , .28 
.26 .17 



-2.02 
-b.J6 
-3.08 



541 
575 
655 



.74 .20 
.2,2 .11 



-4.45 
-2,13 



50 
231 



13 .22 



2.08 



301 



) ( 'H1 in 1982 



mol Change on A 1 1 i>rii;i t i Education Goal 
i m i iase Acndein i c Succchs 



Pro ) or. t and 
School 



lea lo Score 
1981" '7 082" 



statist i 



Degrees of 
f r eedom 



Mr.)'. mi e : M udent ' Sel f -report rd Grades 



V.ov : ! . ut i on a 1 Rig ht s 
Four in 1 1 on 
Muir HS (H2) 



529 



Puerto Ri.ro 

Hni £ ; Relvi s Kl ( 2) 

Char 1 est on 

R-ivers MS ( 743 ) 
Brown HS 4 7f>A"5 



2.40 2.18 



2.89 2.6 5 
2.45 2.32 



-2.31 



'^3\ 6 1 
-2. 76 



38: 



583 
619 . 



Virg i n I s 1 .,nds 

E i c'na C h i i s t i an J H S 



,36 



16 



-2.5: 



496 



St. Paul 

Johnson HS (230) 
Washington MS (352) 



2.83 2.67 
2.68 2.46 



-2.02 
-2.02 



422 
322 



Noto^ Only ' those schools where the change from 1981 to 1982 is regarded as depen- 
dable are included on this ?able. sports of change* on teachex; survey measures 
are excluded from this table when r i»c number of teacher? surveys on which, the ^982 % 
mean is based, is fewer than 11. L-s t q.t1 s t i cs for compositional measures are'" 
based on the means, and standard deviations for each ochool . For psychosocial cli- 
mate measures, the "t/'Stat ist ic*' is'th'e ratio of the' difference between 1982 and 
1981 scores to the standard error, of measurement of the 1982 scores. As a rule of 
thumb, psychosocial climate measure differences that are twice the standard error 
of mcas-uraiifiit may bo 'regarded as 'dcpcudabl e . Dashes- in th<> column for Jegrees'of 



f r e e'd om i a d i c a t e that 1 1 



i ensure 



i s a psychosocial climate measure. 



ft 9 



ERLC 



1 ( )81 t <» \ ^8*' - School Change on Alternative lvduratiou Goal 
Improve Trans 1 t ; on to Work and Van t -se condai y Kducfction 



r r o j e o. t ■ 
School 



ami 



lie a 1 1 * Sc ore 
" 1 M81 l ( JH? 



Mr as u re 



s t. a t l a tic 
StuJ-nt s' Ftluca t i on a 1 Kxpoctat i on i! 



Drj'rccti of 
i ; . edom 



Chicago Board of Kducation 

IUmUi-ui]):; Kl ( f >7 l )0) , '3 > A 'V.0f> 

Rrcjnx ^ 

(>3 3.01 r > 3 



2 .01 



270 



Note . yJnly those schools where the change" from 1981 to 1982 is regarded as depen- 
dable are included on thi* tattle. Reports of change on teacher survey measures 
are excluded iron this table when the number of teacher surveys on which the 1982 
moan is based, is, r ev* t than. 11. t-sta C i s t ics for compositional measures are 
based on theAmeans and standard deviations for each school- For psy chosoc ial r 1 i- 
mate measure*, the n t.-staUst i c" is the rutift of the difference between 1982' and 
1981 scores to the standard .-rror of measurement, of the 1982 scores- As a. rule of 
thumb, psychosocial «' T ;mate measure differences that are twice the standard error 
of measurement may b<- r< yarded as dependable., Dasher in the column for <.'• .-.rnes of 
freedom indicate that the moafsun is a psychosocial climate measure. 




l\nv i i (Min < * u I .1 ml !>»■ I 1 nq urn 1 

Ti ua icy . T.i h I i' H shows ( 1 1 a t 
. 1 :: v ' 1 II ( Hi <»■ j it I fi had !;i fll I • 

I i <* an I 1 y 1 1 e ss se 1J •• r open t ed School 
Nonat t endance ; our 1 « > n I i u I school 
had si KUi I ican t 1 y mnie School Nonat 
tendance . * 

.^JV ^ AQJ-JLW?. c ^P.l.liU , • Resul f s for 
measures of the fairness and rlarily 
of school rules presented in 

Taole 9. The result. 1 ; in this table 
mirror the results shown earlier for 
the Pribram boJrt, score on these meas- 
ures. As many schools significantly 
increased in the Clarity' of Rules as 
decreased (two each), and the only 
two schools that changed signiti- 
cantly on the measure of Kairnoss of 
Ru 1 e s .^cTe^c r e a s e d . 

? .? aro nt ! commun i t_y ^ and s tuddn t 

par t ic ip a t ion . Ta b 1 e 10 s how s t h tft 
Plymouth Central Middle School sig- 
nificantly declined on both measures 
of Student. Influence, while one ^ 
school each in Charleston and P£D 
showed significant increases in^ 
Par ent-Corathun i ty Invol vemerR , andv 
Puerto r i^Q^'sh owed an increase in 
Student Influence according to 
teacher reoorts.- f\ 



Aliei 



i ena t i on . Ta b 1 e '10 also/ oh ow s 



tha' 10 schools significantly 
changed in the 'measure of student 
Alienation (down in five and up in. 
r>ive). In the five schools with 
s i gn i t ica n t i n c r e a h (J s in Alienation, 
two are control school;?, project 
schools in Plymouth- (2}^and St^Paul 
(1) also ah owed significant • 
increases in Alienation. Two 
schools in Charleston and one school 
each in Pas°adena, PCD, and Harlem*^ 
h:rn 1 owe r A 1 ien a t ion scores in 1982 
than in. 1981 . * ■ 



3.* Although the Harlem school's 
response rate v in 1982 was withi^P 
t:f its 1 984 'response rate, it wa's • 
vcr v y low bot"h years- , , 



Se I I ■ i i >i . . « ] ! f . ! ■ 1 >\u U 1 i a ti !j 

I itc 1 1 • a s e -i ! i v 1 I 1 vi' < lu >o I s in the' 
measure (»? Positive Se 1 1 -Com r p( ar e 
f, hnwn i u i !» I e II.. These t i Ve 
included twe project and our control 
s ciiool i n * Cha r I es t on , Mi 1 wood Jim i "i 
High School in Kalamai'.oo, .ed the 

II a r 1 em pr o ) ec t sc hoo 1 ( :»ee [ i ) ot no t e 

o . 

Te/ic hei '...exp.ee t at i ons . (>n 1 y one 
school changed significantly on the 
measure of teacher expectat ions, 
llxpect ations of i ;t udents were more 
positive in "a milidle school in ''iy" 1 
mouth in l ( >82 than they wore in 
1981. 1 (This outcome is counter (a' 
mo s t result. 1 ; f or this school.) 

Other measures of psycliosoc ij ij 
deve lop me nt . • Six schools changed 
significantly on measures of rebel- 
lious au t on om y . Ta b 1 e 12 shows that 
of the 1; c six, f i v e pr ogr am sc. hool s 
had lower scores in 1982 and one 

■. v on t r o 1 s c h 00 1 ha d h i ghe r s c o r e s in 
1981. The s:ui\e table shows that 
only- two program ^schools showed 
increase:, "on the measure of stu- 
wents' practical Knowledge (one each 
in H a fi em a n d PI y mo utii) . F i ve pro- 
gram schools and' one control school 
!. ad s i pan f i c a n 1 1 y ' 1 o w e r s c 0 r e s on 
this % n\e iisurc. These five in c 1 ude 
0 n e control s c h ojo 1 in Kal am r . fc no, an 

. e it me At any school in CBE, and three 
program school s in St . Paul . . Two 
program schools ir rT *'«ased in Inter- 
p e r s on a 1^ Com p e t. ;uy scon s . on e *i n 
CBE and one in ai ! -s i. <ui. Cons id - 
er*inft these pr \ . 1 \i -soc i«*. ; { v vol opment 
in.ii/f-r over:'.;)*. »'e lb ,n. twice as 
n any prop ran ■ :» ' > in>; oved as-* 
dec 1 itfed . * > 

^dtu; at „iona 1 st ruc_c i ire s . ' Jlu: r e 
are 2 7 significant differences on 
me a $\fr e s of ed u catj o n a 1 s t r u c t ur t s 
h-wn iu Table 1 ? \ Of these. 27,, 9 



■ r v 



in a favo r a h i e di r eot i o|i , and 



i '. were in the direct ion Opposatg 
j hat sought. No clear or sy s*t:em.\t ifc 
pattern across * schools or projects 
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Table $ 



I *UU to/l**H2 S« lu >t> 1 (Muin> v ,r on Alternative ^duration Uml 

i in i rase At t eudance 



Project and j*ciijt\_ A* : PJI\.- t Decreet* ol 

Siiiool 1981 1982 MtaLiutic freedom 

„ ... J _ _ 5. . # - ...» - » - .. - ■ - ~— « - , * . L - . 

MeasuVe: Student*;* Self-reported School Non-attendance 



Peer Culture Development 

Harrison US (1370) .02 ,53 -2.02 628 

Ka f am a zoo 

- South JUS ( 3.27) (control ) .19 .28 t 2. OA 450 

Jazzmob ill? 

88. .31 .18 -2.73 381 

• <» 

Plymouth , 

'Growth Works (1) .89 .65 . -2.12 '57 

Note" Only those schools where the change from 1981 to 1982 is regarded as depen- 
dable arc included on this table. Reports of change on teacher survey measures 
•$re excluded, from this table when the number of teacher surveys on which the 1982 
mean '"is ba*sed, is fewer than 11, t_-staiisti.es for compositional measures -are 
base-d oq the means and standard deviations lot each school. For psychosocial cli- 
mate measures, the "^-statist ic" is the rat tc of the difference between 1982 and 
1981* scores- to the standard error of measu oment of the 1982 scores. As a rule of 
thumb, psychosocial climate measure differences that are tw ; ce the standard error 
of measurement may be regarded as dependable. Dashes in the column for degrees of 
freedom indicate that the maasure^ Is a' psychosocial climate measure. 

' ' * 



c 
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Irhoo! Chaise on Alternative Kducation Objective; 
Making •'" hool Discipline Fair and 
Consist mt While Providing fi»r Du«' Process 



'i - ■■ ; im t and 



Scale Score 
1981" 19JB2 



statistic 



Degrees of 
freedom 



Measevr: Students' Report s of Clarity of Rules 



.iluijiK" hoard of Education 
Bontrmps £1 ( r )7 50) 



,77 .67 



-2.12 



•' r ' ulture Development 
Harrison HS (1370) 



,62 .73 



2.24 



Plymouth 

Growth Works ( 1 ) 
Central MS (41) 



.62 
.72 



.73 
.60 



1.20 
-2.51 



/ 



Measure; Students' Reports of Fairness of Rules' 



Kalamazoo 

South JHS (327)(.controi) 



.67 .54 



■2.35 



Plymouth 

Centra! MS (41) 



.56 .39 



-3.34 



Note Only those schools where the, -change- from 1981 to 1982 is regarded as dependa- 
ble are included on this table. Reports of change dn teacher survey measures' are^ ' 
excluded from this table when the number of teacher surveys on which the 1982 mean 
is based Y is fewer than 11. t-statistics for compositional measures are based onC 
•he means and standard deviations for each school. For psychosocial cl imate mea- 
sure's-; — rh^^t.-statistic" is the ratio of the difference between 1982 and 1981 scores 
to the standard^ error of measurement of the 1982 scores. As a rule" of thumb, psy- 
chosocial /limate measure differences that are twice the standard error of measure- 
ment may be vregarded as dependable.. Dashes in the column for degrees of freedom 
indicate that lYd measure is a psychosocial cl imate y measure . 
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T4ble 10 • ^ 

1 - T , 

1981 to 1982 School Change on Alternative^ Education Objective: 

Increasing Ybuth, Parent, and Community Agency- 4 

participation in School Decision Making, to 

Reduce Student Alienation . ' ' . 

..... k~,~~:~ — 

Project and S f c^ale Score • t Degrees of 

School ^ . 1981. 1982 statistic freedom 

™" " — 7" - 1 ' — 7" 

Measure: Students' -Reported Student' Influence 

___ — i _ — -r— — — -rr-v:™- 1 " " 

Plymouth . 

. - Central MS .(41) .46 .35 ^ -2.17 

Measure: Teachers' 'Report of Parent and^Comkunity Involvement 

Peer Culture Development r . 

Harrison HS (1370) m "1,09 1.30 .. 2.99\ \ ~ 

Charleston 1 ^ ^7* 

Courtenay MS (741) ° 1.31 1.45 2.16 
_„ „ . „__„^„„„„ ^„ 

a Measure: Teachers' Reports of Student. Influence in School 

Puerto Rico . ^ 

Dr. Aguayo HS (3) 1.52* 1.71 2.17. 

Plymouth ■' / . • ,Vy^ ^ ^ J 

Central MS (41). 1.54' 1.35 -2r*3 , ^ 

/■ (cont.) 
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\ Table 10 (continued) 



Project' and 
_1 Sfchool 



Scale Scor6 t ■ Degrees fc>f 

1981 1982 statistic freedom , 



Measure: Students' Alienation 



Constitutional Rights 
Foundation 
Elliot*- JHS (7J0) 

Peer Culture Development 
Harrison HS (1370) 

Kalamazoo 

• South JHS (327) (Control) 
Jazzmobile 



.42 .35 
.39 .32 

0 

.37 .43 
.31 .20 



-2.99 



-3.04 



2.25 



-2.04 



522 



542 



384 



Ik; 
135 



Charleston 

Laing MS { 242) (control ) 
A.B. Rhett MS (742) 
Burke HS (7.55) 

Plymouth * 
East MS (31) 
Central MS (41) 



.38 .44 
.33 .25 
.27 .22 



.33 .42 
.35 .44 



2.98 
-2.97 
•^2.51 

2.04 
'2.03. 



573,. 
511 
608 



224 
220 



St. Paul. 

Murray MS (342) 



.27 .36 



3.04 



383 



Note . -Only those schools where the change from 1981 to 1982 is regarded as depen- 
dable are- included on this table. Reports of change on teacher survey measures 
are excluded from this table when the number df teacher surveys on which the 1982 
mean' is based, is fewer than 11. t.-statistics for compositional measures are 
based on the means and standard deviations for each school. For psychosocial cli- 
mate measures, the "t.-statistic" is the ratio of the difference between 1982 and 
1981 scores to the standa'rd error of measurement of the 1982 scores. As a rule of 
r thumb, psychosbcial climate measure differences that are twice the standard error 
of measurement may be regarded as dependable. D&shes in the column for degrees of 
freedom indicate that the measure is a psychosocial climate measure." 
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\^ Table 11 

»• ^ 

1981 to 1982 School Change on Alternative Education Objective: 

Preclude Labeling Effects 

Project, and Scale Score ' i - Degrees' o^ 

School ■ • ' 1981 1982 statistic; freedon 

' «f y — * _ 

1 — • 7 " _ ~ ~ 

' '■' . Measure: Students' Positive Self-Concept 

. ■ <--'. . 



Kalamazoo 

Milwood JHS (318)' 



,69 .74 



2.69 



576 



Jazzmobile. 

88 ' -71 .80 3 .1;7 133 

i - * • 

Charleston 

Charleston HS (751) Ccontrol) .77 .80 2.08 421 

Burke HS '(755) .'7.9 .82 2.97 550 

Haut Gap MS (944) .73 .77 * 2 ' 18 # . ' 444 " 

_ _ — __ . __ — . .- — _-_-_- — — — . "~" — — — — — — _ _ _- — "~" — — — 

y Measure : Teachers' Low Expectations 

__-_____-_._-___„— ir" ' Tj * 1 * 

, ■ _. 

Plymouth k 1 . ./ " - 

Central MS (41) 35.36 23.29. -2.10 51 



Note . OrUy those schools where the change from 1*81 to 1982 is regarded as 
dependable are included on this table. Reports of change on teacher survey 
measures are excluded from this table when the number of teacher surveys on 
which the"l982 mean is based, is fewer than 11. .t-sdatistics for composi- 
tional measures are based on the means and standard deviations for each^ 
school. For psychosocial climate* measures, the "t-statistic" is the ratio of 
the difference between 1982 and 1981^ scores to the standard error of measure- 
ment of the 1982 scores. As a rule "of thumb, psychosocial ( climate^measure 
differences that are twice the standard error of measurement may be regarded 
as dependable. Dashes' in the column for degrees of freedom indicate that <"he 
measure is a psychosocial climate measure. 
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Table 12 



1981 to 1982 School Change on Alternative Education 
Promote Educational .and Social development 
by Providing Appropriate Learning Structures 



jective: 





Project and^ 
" School 


Scale Score 


t 


• Degrees of 




1981 1982 . 


statistic 


freedom 




* " ' Measure: Students' Rebellious 


Autonomy 






V « 










Chicago Boaf$ of Education ' 
Bowen HS' (1240) 
LueU.a "El ( 4550) (control) 


* * 

.62 ' .53 
.55 .68 <* 


-1.98 
, 2.09 


, 264 
144 




Kalamazoo 

Milwood JHS (318) 


,.73 .63 


-3.14 


493* 


K 


Jazzmobile 
88 


'.74 .56 


-2.78 - 


116 




Puerto Rico > 

Santiago Gonzales JH^- (1) 


.47 .39 


-3.13 


688 




Plymouth 

East MS (31) 


.79 .69 


-2.28 


215 




Measure: Students' practical Knowledge 






Chicago Board of Education . 
Blaine El (2300) " . .. 


V 

1.37. 1.26 


^2.00 


315 

( ' *' 




Kalamazoo • • 
South JHS (327)(control)' 


>1.39*1.25 


-.'c2.92. , 


375 




Jazzmobile • ' ' ■' 
88 ^ 


.97 1.35 


■ / 

• •• i 

4.33. ' 


126 

As . 




CI 

Plymouth • 

Central MS (41) N - 

■ ■ ■* ■> 




2.10 ■* 


221 


i 

» 

Mi 


St. Paul ■ 

Central HS (210) 
Murray MS (342) • . 
Washington MS (352) 


1.57 1.36 
1.40 1U5 
1.19 '1.03 / 


-4.03 

••A. 82' 
-2.58 


258 

366 

- 261 . 

i 



9 

ERIC 



-87- 



100 



Table 12 (continued) 

9 J3 l_. ' : ----«- 

——————————————————— ~~— ~~— ^ — . 

Project and , ^ . , Scale Score t Degrees of 

Schopl ' 1981^*982 * statistic § freedom 



4 



Measure: Students' Interpersonal Competency 



Chicago Board of Education"- 
Bont&nps El /5750) 

' ' • *" v 


.80 


!86 ; - 


2.50 i 


277 _ 

<. ■ 


Charleston / - 
*A.B. Rhett MS (742) : 


.75 , 


.80 


2 *68 • 

t 


5 03 


Measure: Students-Reported 


Parental Emphasis oti Education^ 




Peer Culture Development 
Lake. View HS (1430) 


.49 


.43 


-2.25.' 


.. 480 ' 


Chicago Board of Education. / 
LeMoyne El C4440) • 


.68 


.60. ' 


-2.03 


188 


Kalamazoo 

rfilwood JHS> (318) 
"South ,^HS .( 327 ) (con trpl ) 


.68 
.68 


.62 
.61 


-2o6 
-2.45 


623 
425 


Bronx 

tr 22 
* 63 ■ 


.66 
.75 


.56 
.61 


-3747 
-3.57 

~) 


'416>* 
1.69 


Puerto Rico 1 ' 
Rui's JJelvis £1 (2) 
Dr. Aguayo HS' (3) 


.71 
.63 


.64 
.58 


. -2.35 • 
-2.18 


336 
805 • 



Measure: Students' Reports of School Punishments 



Bronx ' ' „ „ - , 

22 • - .27 .21 -2.30 437 

63 «, . .31 .2-2 -2.66 « • 187 

s 

Charleston 

' Laing MS (242)(contrbl) tt.6 .22 2.45 , 613 

'Brown HS (754) .24 .19 -2.40 580 

^Central MS (41) -16 .27 . 2.69 ' 221 



Table 12 (continued) 



Project and 
School ' . - 


Scale 


' Score 


* — t' 


Degrees of 


1981 


1982 


s tatistic- 


f reedom 


* 'Measure:, Student's 


Self-reported 


School Rewards 




> 

Chicago Board of Education 
Blaine. El (2300) 


.23, 


.33 


3.03 ' • ■" 


319 


Bronx 
* 1 63 


.33 
.52 


.24 
.32 


-3.16 
-3.91 • 


A 1 O 

438 
' ; 187 / 


Puwrtp Rico * , '* 

Santiago Gonzales JHS, (1) 
Ruis Belvis El (2) 


.43 

--.47 


.28 
.35 


-6.52 
-3.55 , 


742 
336 < 


Virgin 'Islands. * ; 
Elena Christian°JHS 

Plymouth 

Central MS (41) 


„ .28 
.26 


.33 
.16 


. 2.00 

V 

-2.68 


• 473 

■ \ 

22* ' 

» 


St. Paul 

Murray MS '(342) 
Washington, MS (352) 


.29 
.15 


.19 
.22 • 


-3.32 
2.37 


402 
309 


Measure: Teachers' Reports of Individualized Instruction 


Charleston 

Charleston HS-^751) (control) 


1.82 


1.09 


-2.08 




Bronx 

63 


1.94 


1.18 


-2 ."80 





"89- 102 




. -,\. • ; . ; . ; 

\ .Table 12 (Continued) • • % 

s »■ • ' . • • • • ■ « '■ 

_____ ____________ ^ ; * *_ I _. ___ • i 

Project and ' Scale x Score ' t 'Degrees of m J 

School ' . 19&1 1982 1 * statistic /freedom 

„ T """"" " rs; / 

_ . fc Measure: . TeapherSe' Use of T^pe B. Sanctipns * ■ ■ 

_ : _; . 1 ,L' . -! i. - i o /' 

. — , . r . 

• • . . - * . . • , • ' * I 

ft • ». * 

Charleston • * • • . . 0 ^ ' 

Charleston HS (7510 (control) . 2..47 1.98 -2.37, - . 27 . ^ 

1 r - - — **- ttV-: — -— " . 

Measure:' Tethers 1 Non-Authorit;ar.ian Altitudes 

_^^___^_ 7 _^_^ --------- - 

Virgin Islands ^"^i* v . * 

^Elena Christian J«|;;(0) ; 2.31 2.6L ; ,2;29 J ';^ ^ 118 > - 

Note.' Only those schools where the change :£rom\L98V to 19*82 is regarded as 
dependable aye included on this table. Reports 'of t change on teacher survey 
measures' are exclude^ from this table when the number of teacher surveys on 
which the 1982 mean is Sased is ffewer than 11.' jt-statis tics, -for composi- 
tional measures are bafced.ori the means and s&andatrd deviations for each i < 
school.. For psychosocial climate measures, the "t-statistic" is the ratio % 
of the dl^ferenQe'between 1982 and 1981 scores to the standard error of * 
measurement' of the 1982 scores; As a rule of'thurb, psychosocial clittate ' ■ 
measure dif f erences > that aire twipe the standard error of measurement may 
be regarded as dependably. Dashes in- the. column for deggre.es of freedom- 
indicate that , the measure is a psychosocial climate measure. 
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Environments and Delinquency 



f -^appears in the results, although it 
: * is: striking that/no school increased 
on Parental , Emphasis on Education j>r 
. Individualized -Instruction, and > 
\ ■ eight* decreased on * Parental Emphasis . 
anA; two decreased in the measure -of 
Individualized Instruction./.. 

Organizational 1 health . Outcomes V 
for tfie measures presumed to be 
related to prospects for organiza- 
tional deyelopmerlt'^^e" sflown in 
Tabl%13.. : in all,- 2?>signif icant 
% ^^ an ^. es occurred, of which 17 are in 
> \the positive direction. Of the 
•eight negative changes, three were 

* for'control schools* The measure's/ 
<s showing most positive changes were 

Teacher Commitment and Teache^ . '«/ 
Morale. Three Charleston schools, a 

* high school in Puerto Rico, and East 

. Middle School in Plymputh signifi- r K 
. * cantly* improved on Commitment, or 

Morale Two schools in Puerto Rico, <j 
one*>in' Charleston, e and the program 
school in Kal&ma'zoo. shpwjed signi^fi- 
[i "cant increases in teachers' reports " x 

*of Smooth Administration/ 

■ * . 

Other delinquency risk' factors . 
. A* summary of significant differences iC 

• between 198L and 1982 for othqr the- 
oretical risk factors for delinquet 
behavior is presented in Table 14. 
Four program schools showed « 

• t decreases in Attachment tp Parents, 
and a control school showed 1 an ' 
increa&e. Attachment to School 
increased in two program schools and 
one cbptrol school and decreased in 
four program .schools and, two control 
schools. , Four schools increased in 
student Belief in Rules and one * 
school deceased (all are program 
s.chool"6). «The program schools show- 
ing increases "vermin <6t. Paul, 
s (?fra'rle4ton, Harlem % (see footnote 3), 
and CBE. 

V ... Negative Peei^ Ipf luence decreased 
„ in four ^program schools in Charles- 

• , ton (2), Harlem*, and Pasadena; and 

it -increased in qne program and one 
control- school in Charleston. ,% * 



Discussion 



Lfinitat ions 



Co-occurring events . The major 
limitation of ^he results presented 
here* is that they all describe' 
chaiygeg in th^ population ItfVels of. 
d el ipfluerit^ behavior , other 'behavior , 
other psychosocial characteristics , 
and-'sfchool environment jvbettfeen 1981 
and 1982. without ref eren&tSvto the 
source of the change. Any wjor \ 
eyeflt that occuiyred in the environ- 
ment, structure^ staff ing, -leader-- 
^ s-hi^), .or ' financial resources availar 

.ble to a school — or even economic 
'conditions, and school system poli- 
ce ies — are potential explanations of 

-•s'u'ch changes from year' to year. ■■ The 
Alternative Education projects oper- 
ating ip these a schools are generally 

* one. such ^^a^ or' occurrance. )' 

^Sometimes it, is "difficult to have 
much confidence in an interpretation 
that a project operating in a schopl 
caused tl/e, changes observed. For | 
example, a. junior high school in 
P lytooutl^/ showed significant 
increases* \n flelrnquent Behavior, \ 
stOdent Aliena't^On, School Punish- j 
iqehts student Victimisation; it , 1 I 

* showed significant decrease's in 
teacher Safety, Fairness of Rules, 

-Clarity of Rules, Student Influence 
as reported by teacha^s and 'stu- 
dents, School' Rewards, Attachment to 
Parents, ,and, student reports of 
school Planning and Action. But 

* these ou^cfynes are , hard to interpret 
as effects bf the alternative educa-\ 
tioti proj ect operating in the 
school. The project primarily pro- 
vides direct servibes to -a selected 
group of students^ had no major 
projiect component "directed at 'school 
organizational change, arid therefore 
is not a plausible explanation of 
this subs tantial de ter ioration in ••*" 

^school climate. A more plausible 
explanation ' of the results is the 
change in grade-level organization 



to 



1981 to 1982 School Change on^Tfeasures o£ Organizational* Health 

\ 

\ J i ^ . ^ 

Project and Scale Score t^t ' . Degrees- of 

School' . 1981 1982 §tatisTic freedom 

— — — — — — — — ~~ ~ ' "~" *~ k » t t 

Measure: Students' Reports of School Planning and Action 



Peer Culture Development 

Curie HS (1870) ' 1.63 1.50 -2.17 



4 



Kalamazoo 

Mil-wood JHS (318) ' 1.58 1.80 3.60 

' 1 

Puerto Rico ^ . , 

' Santiago Gonzales JHS ( 1) 1.63 1.75 2.09 

" "Dr. Aguayo HS (3) \ ' 1-69 1 .83 2.41 

Charleston . 4 
Charleston HS 

(751)(oontrol) 1.70 1.53 -2.88 

H'aut Gap MS (944) 1.66 1.80 2.46 



\ 



lOtf 2- . 



Peer Culture Development . 

• Harrison HS- (1370) ' .46. .56 ^ .2.05 , — ' ..' 

-t ' s\ '' • * * - ' ' «| 

ChLcago Board of Education ' " • . . ' 

LeMoyne El f (4440) . .39 .49 2.08 

• '"• Y- 

K 'Charleston * . ' • 

' Burke HS (755) .66 .55, -2.19 — . . » 

Plymouth . s * 

Central MS (41)* ~.47 .37 . -2.04 ~ 

. r Measure: ' Teachers' Reports of Planning and Action 

Puerto Ric<5 , " 

Dr. Aguayo HS (3) V - 1.68 1.83 2.26 

.__ _ - ^ ^ 

Measute: Teachers' Reports of Smooth Administration 



Table 13 (ccmtinued) 



Project and 
School 



Scale Score *t , Degrees of 

1981 N 1982 statistic freedom 



Measure : Teachers' Commitment 



Constitutional' Rights 
Foundation 
•Muir HS (82) 

Puerto Rico \ 
Dr. Aguayo HS (3)^ 

Charleston 

A\B. Rhett MS (742) 
' Haut Gap kS (944) 
: ' St. John's HS(951> 

Plyjnouth 

E*st* MS (31), 



1.68 1.50 

1 .63 : 1.87: 

1.41 1.62 
1.66 1*91 
1.49 1.67 

1.40 1.70 



-2.12 
i 

.2.85 



2.49 
. 2.91 
2.18 



3.54 



Measure: Teacher Morale 



/ 



Kalamazoo 

.South JUS (327)(control)' 1.62 1.49 * * -2.40 



Puerto Rico 

, .I>r. Aguayq HS (3) - 

'.. «'•' " 

Charleston 

Haut Gap MS (944) 
St. John's HS (951) 



1.57 1.76 



1.61 1.76 
1.50 1;62 



3 .60 



2.78 • 
2.12 , 
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^ * Table 13 (continued) - . 

_ — - — - — — - 

'Project \and Scale Score . ■ • t Degrees of. 

School ' . *f e ' - 'J .9.81 198'2 statistic freedom 

, ( . -; - Measure: "^ea'cher | 8 ' ; Job 5ata.sf action . % 

-*-*----.----- .w— L— T — ------- r - — r-- . ; 

. . • v- . . . 5 * *• .. : / 

Puerto Rico . 1 " : * . " . • 

0 tiro Cam in o>- . • >' -3.30 2>:94 -2.13. . 18 

; \s . i . . • 

Virgin Islands '. \ '■ • 

EleTia bhri^tia^. JHS . 2.^2 2.72 J.97 , 128 ... 

Meapur£:. Tochers' Professional Development ^ 

— ^ — - 1 r "" 7 "7 

'Chicago Board of Education f *■ * , 

* Bowln HS (1240> , ^ ; .1.33 1.44 ' 2.0> . 88 

Kalamazoo 1 ., > • . ►.«»'' ' •»« 

South. <JHS (327) (control) 1.54 1.36 -2*45 30 

' 

Note: Only those schools where the"' change" from 1981 to 1982 is regarded as depen- 
dable are included on "tfris table. Reports of change on' teacher survey measures 
are excluded fromUhis "table when, the .niimber of .teacher surveys on which the 19 M 
'mean is based, {s fewer than 11.. t-statistics for compositional measures are 
ibased on the means and standard deviatflbn^ for each school. 1 For psychosocial clx- 
•mate measures , ' trie "t-statistic N " is the, ratio of the- difference between 1982 and 
1981 scores' to the standard- error of measurement of the 1982 scores. As a rule of 
thumb, psychosocial climate measure differences that are twice the standard error 
of measurement may be regarded as dependable. Dashes m the column for degrees of 
freedom- indic^e that ihe measure is a psychosocial climate measure. 
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.... , ^able 1% 

/ . , ■ ■ '(. '.' 

1981 to 1982 School Change on 

Additional Theoretical Predictors of Delinquency' 



Project and 
School 



■ Scale Score 
1 ^981 1982 



t Degrees of 

statistic '• freedom 



— ^r- 

Measure: Students' "Attachment to Parents 



Constitutional Rights 
Foundation 
Elliot JHS (70V,> 
Muir HS (82) '. 



.64 r .58 
.63 ..56 > 



-2.39 
-2.66 



601 ^ 
508 



Chicago Board of Education 
Luella El (4550)(control) 

Bfconx 
\63 



.57 ' .65 » » 2.11 



.71 .62 



-2.48 



217 
211 



Plymouth , 

Central MS (41) 



,72 -.56 : * -4.04. 



225 



Measure: Students' ^ttachment to School 



•5" • 0 
Peer Culture development • 
Harrison HS (1370) 



,71 .75 



2.01 



590 



Chicago Board of Education 
Luella El (4550)(control) 
Bontemps El (5750) 

• : ' 

Kalamazoo • *\ 

South JHS (327) (control), 



\ 



.57 .65 
.71 . .64 



,65 .57 

\ 



2.13 
-2.7 8 



-3.08 



17 6 
308 
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Table 14 (continued) 



" Project arid 
% School 


Scale Score 


v — * t 


Degrees of 


1981 1982 


statistic 


freedom. 


Measure : Students' 


Attachment to School 


(continue) 


* . * 



Jazzmobile ' > 

88 '.$8 .78 2.78 ; • 183 

Charleston . . 

. Laing MS (242)( C yntrol) .69 .63 -2.65 611 

St . .Paul • ' ' v 

Murray -MS" (342) 4 .71 .59 -4.09 402 

Measure: Students' Belief in Validity of Rules 

Chicago Board of Education • 

Bowen HS-U240) . • . ' ' jvl .77 2.16 , 270 

Bontetnps El (5750) ■ , y .66 .60 -2.17 .282 

JazzmobiTe ^ 

88 ? \ ' ^ -62 .73 3.01 12^ 

Charleston < 
,Haut Gap MS (944)^ .64 . .69 2.32 506 

St. Paul : 

Central HS (210) ' .67 J .74 2.33 . . 257 



Table 14 (continued) 

_ . . „— L 

?rb'ject and , Scale Score t Degrees of\ 

School * 1981.1982 statistic freedom 

Measure: Students' Reports of Negative Peer Influence 



Constitutional Rights 
Foundation 



Muir HS (82) • 

* 


.19 


.15 


-2.26 : 


499 


Jazzlnobile 










88 /■ . ' 


.21 


.16 


-2.13 


312 


' / < ' v • . * 

Charleston 








* 


/ A.B. Rhetf'MS (742) 


.17 


.14 


-2.34 


585 


Rivers MS (743) 


.18 


.22 


2.31 


535 


Charleston HS •( 751 K control ) 


.13 


.16 1 


2.08 


489 • 


Burke HS. (755) 


.22 


.18 


-2.95 


699 


Measure: Disrespect' for 


Students 






Kalamazoo • 










South JHS (327) (control) 


.91 


1.08 


2.20 





Note / Only those schools where the change from 1981 to 1982 is regarded as dependa- 
ble are included on this table. Reports af change on teacher survey measures are 
excluUed from this table when the number of teacher surveys on which the 1982 mean 
is based, is fewer tfyan 11. Jt-statistics for compositional measures are based on* 
the means and standard deviations for each school'. For psychosocial climate mea- 
sures, the "^-statis^ic" is .the ratio of the* difference between 1982 and 1981 scores 
to the standard errwt of measurement of the 1982 scores,. As a rule of thumb, psy- 
chosocial climate measure differences that are twice Jthe standard error of measure- 
ment may be .regarded as dependable. Dashes in the column for degrees of freedom 
'indicate that the measure is a psychosocial climate measure. 
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that occurred in the Plymouth 
schools during the 1981-82 school 
year. Both middle schools were con- 
verted to junior high schools, thus 
returning more troublesome 9th grade 
students to the school rather than 
moving.' them onto the high school 
cajhpus. 

similar grade reorganization 
occurred in the Puerto Rico schools. 
Structural changes in the Puerto 
Rico schools between 1981 and 1982 
involved decreases in the school 
population and a move from split to 
single sessions. Results for both 
the Plymouth and Puerto Rico proj- 
ects should be regarded as tricky to 
interpret. 

A similarly difficult to under- . 
stand set of results occured for a 
PCD high school where School Nonat- 
tendance, Alienation, and student 
reports of school Planning and 
Action decreased^ significantly and 
where Clarity, of Rules., Parent and * 
Community Involvement, Attachment to 
School increased significantly. 
This project operated a closely ( 
similar intervention in two other 
high schools in the same city, and 
the results do not resemble* the 
highly positive change in school . 
climate registered for the school 
just described. In this case it is 
possible that the PCD project, con- 
tributed to the positive changes, 
but neither the experimental compar- 
ison of the project's intervention 
within this school (St. John, 1983) 
nor convergent evidence from other 
schools supports this interpreta- 
tion. Other co-occurring events are 
explanations, that rival the inter- 
pretation that this felicitous out- 
come was due to the project's inter- 
vention. 

A third example involves results 
for the LCO reservation school for 
which results were not tabled in the 
this chapter (they arc? shown in 



Appendix D) because the 
s_tudent- survey response rate dif-' 
fered* markedly for the 1981 and 1982 
administrations. Political changes 
on^the reservation that resulted in 
th^ firing of a largDe proportion of 
the teachers in the ^school are pro- 
bably major contributors to the 
drastic negative changes reflected 
in the teacher survey results. In 
this school, teachers reported sig- 
nificantly lower Safety, less Stu-» 
dent Influence, less Parent and Com- 
munity Involvement, and very much 
lower Morale in the second year. 
This outcome lends support to the 
validity of the teacher-survey meas- 
ures, but it would be absurd to 
attribute the resul~t:s-^e- the opera- 
tion of a relatively-^ow-key project 
(Cook, 1983b). , ^ 

Riders can gain^gr eater insight 
into the nature^ amplitude, and 
direction of other influences on 
ea^h project by consulting the first 
and second interim evaluatioji 
reports specific to each. 

Changes in sampling . The results 
summarized in this chapter exclude\ 
results where we knew of changes in. 
the ways students were sampled. , 
These changes, which we have taken, 
great pains to avoid, nevertheless 
occurred on occasion. "For example, 
the results do not include reports 
for the Plymouth high schools where 
we were unable to obtain a suitable 
random sample of the studentry in 
1981, and where English classes were 
sampled in 1982 as an expedient 
approach to the assessment of school 
climate. 

Despite our- efforts to exclude 
obv ipusly . less meaningful compari- 
sons, there may remain some compari- 
sons where the quality of "survey 
administration differed to a prob- 
lematic degree for the two years. 
For example, one school in St. Paul 
administered surveys to 56% of the 
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sample in 1981; the report of survey . 
administration for, this school indi- 
, cated that surveys had been adminis- 
tered to 78% of the sample in 1982. 
Many of the St. Paul surveys were* 
sent to us with th^ identification J) 
numbers removed, however, and the 
number of booklets identifiable as 
being from this school resulted in 
in effective, response rate of 59%. 
Neither the effective 1982 response 
rate (59%) nor >the reported response 
rate (78%) were sufficiently differ- 
ent from the 1^81 response rate 
(56%) to warrant excluding the 
school by the criterion we use^d. 
Tables 4 through 14 show several 
puzzling significantly negative" 
changes between 1981 to 1982 for 
this schor The hypothesis that 
sample dii. ^nces explain the 
results is at least as plausible as 
the hypcfohesis that Project Together 
brought about negative changes in 
the school. There is no way of 
knowing how much the group for whom 
questionnaires were available in 

1981 . resemble the group for whom 
questionnaires were available in 

1982, or how much either group 
really represents the school^s stu- 
dentry. 

i 

An example where tjhe response 
rate decreased from 1981 to 1982 may 
illustrate the obverse of the prob- 
lem just described. One Pasadena , 
jP) school surveyed 79% of the sample, of 
" students in 1981 but only 63% of the 
sample the following year. This 
school's results\show lower Student 
Victimization, Classroom Disruption, 
and student Alienation. Response 
rate differences are explanations of 
these results that are at least as 
plausible as the interpretation that 
Project STATUS induced these 
changes. 

These response rate problems do 
not, of course, affect the interpre- 



tation of results for schools with 
high response rates for both years. 
Response rates' for the 1981 survey 
are presented*by Gottfredson, 1982, 
- ! and a detailed listing of 1982 
response rates is presented in r . 
Appendix E. - "J* 

Chance . Some nominally signifi- 
cant results may be attributable to 
chance.^ See the method section for 
a de script ion of thi? 



Ls>vis sue • 

H" • ' 

Scientists l 



Secular trends . Scientists refer 
9 to shifts in the general culture 
over time as secular trends . Cur- 
rently', there appears to be a 
decreasing interest among educators 
in individualized instruction. This 
secular trend appears to be a plau- 
sible interpretation of the statis- 
t ical ly signif icant tendency toward 
decline in individualized education 
for schools studied here. The puzz- 
ling tendency for school averages .on 
.Parental Emphasis on Education may^ 
also reflect a secular change due to 
the recession or other unknowft 
influences, especially because so 
few of the prevention projects * 
systematically engaged in 'activities 
likely to influence this outcome. 

. Changes do not reflect absolute 
levels ,. The results reported here '/ 
are for changes - in tlVe level of the 
variables examined^rather than the \ 
levels of the school characteristics 
or student Outcomes themselves . A 
school that is already extremely 
high in Attachment to School, for 
example^ may remain high from year 
to year/ but show no change in this s | 
measure/. Perhaps no improvement i's 
needed,/ . Readers interested in this 



issue ^should consult the normative^ N 
information provided in an appendix, 
and s4e the second interim report; 
for t/he Charleston project (Gott-/ 
f reds on, 1983) "Ifhere this 'issue i/s 
examined systematically . j 
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Some Interpretations 

Despite the foregoing worries, 
the results .presented in this chap- 
ter are based on reasonably sound 
data^ghd, represent an unusually tho- 
roughgoing scrutiny of the changes 
over time in the school climates, 
and in the behavior, and psychoso- 
cial status of the student popula - 
tions involved in the Program. The 
information presented here is lim- 
ited to population outcomes. Per- 
spectives on the effects of project 
components targeted at defined sub- 
populations are provided in the 
individual interim evaluations of 
each of the prevention projects. A 
subsequent chapter provides a terse 
summary of highlights from those 
individual^ interim evaluations. 

The most important observations 
appear to he the following: 

1. Schools involved in the Pro- 
gram are safer in 1982 than they 
were in 1981. Both teachers and 
students report more safety in the 
second year of the Program than they 
did in the first, and the improve- 
ment is statistically significant. 

2. Teachers in Program schools 
were victimized less in the second 
year of the Program "than they were 
in the first, and the improvement is 
statistically significant. Teacher 
Victimization was down in 22 Program 
schools, and was nonsignif icantly 
higher in only 5 Program schools* 
There is a tendency for measures of ,l 
delinquency ih and around schools to 
reflect less delinquency in program 
schools in 198^ than in 1981. For 
nine of ten measures of del inquency , 
the measures „show less delinquency 

in 1982 than in 1981, although only 
the difference for the Safety, 'and 
Teacher Victimization measures reach 
statistical significance. /A, 
school-by-'school analyses of changes 
show that when all measures of 
delinquency are taken together, more 



than twice as many schools showed 
evidence of signif icnatly less 
delinquency in 1982 than showed evi- 
dence of significantly more delin- 
quency. 

3. The number of schools with 
improved attendance is greater than 
the number with worse attendance, 
but this difference is not statisti- 
cally significant. Schools in three 
projects had -signif icanfcljHbetter 
attendance in 19*82 .than in 1981; no 
program school had significantly 
worserat tendance in the* second year. 



4. Student Alienation decreased 
in signif icantly more schools than 
it increased. Schoo^g in four of 
the delinquency prevent ion jproj-ects 
significantly improved on the meas- 
ure of student Alienation. 

5. Nearly six times as many 
schools improved as regressed in 
measures of student Self-Concept, 
and this pattertf is statistically 
significant. Schools in four of the 
delinquency prevention projects sig- 
nificantly improved on the measure 
of student Self-Concept. - 

6. Students' in significantly \ 
more- schools reported less Rebelli- 
ous Autonomy in 1982 than in 1981. 
Five program schools decreased sig- 
nificantly on the measure of Rebel- 

-. lious Autonomy, and n^ program, 
s chool increased significantly on 
this measure. 

7. On the various measures of 
psychosocial development, more than ^ 
twice a^ many program schools 
improved as showed a decline. The 

v pattern of. results suggests that \ 
modest positive results were V 
achieved in desj.red areas, but thisx 
pattern does not, provide much sup- 
port for a conclusion that these 
results were brought about through 
the specific 8truc,tu4:aL alternatives 
sought in the OJJDP Program design. 
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For example, the Program Announce- 
ment called for "providing learning 
structures tailored to realistic 
levels to promote educational and 
social development." For the pro- ^ 
gram overall, measures of individu- 
alized instruction went signifi- 
cantly down between 19*tt and 1982, 
and most of the other measures of 
ai ternative educa tional structures 
showed a tendency 'to decline, but 
most measures of social development 
went up. As a second example, the 
Erogram Announcement called for 
"increasing, youth, parent and commu- 
„ nity agency participation in school 
decision makings to reduce student 
alienation." Although, alienation / 
was reduced, students report (non- 
signif icantly ) less influence in 
more schools than they report more, 
and there is only slight suggestion 
of increases in parent or community 
influence. Furthermore, an examina- 
tion of the school-by-school results 
does not reveal many instances of 
co-occurance of desired changes in . 
the measures, of educational struc- 
tures and the measures^ of alienation 
or psychosocial development 

8. Teacher Commitment and 
teacher Morale ...increased in more 
schools than it decreased,* and for 
Morale this pattern is statistically ' 
significant. This appears to be an 
important outcome because of 



4. We explored this issue further 
by examining the school-level corre- 
lations between measures of; the edu- 
cational structures, and. student psy- 
chosocial development. 51 In general, 
these correlations provide little 
support for an interpretation that 
individualized instruction is 
relate^ in the way anticipated with 
favorable psychosocial outcomes. In 
contrast, the correlations do sup- 
port an interpretation that student 
influence *s negatively related to 
alienation. 



evidence .from' other research that 
teacher morale and staff Commitment 
are important correlates of program 
development ... 

9. More schools improved than 
regressed on each of f^ive theoreti- 
cal risk, factors for delinquent 
behavior, although none of the pat- 
terns were statistically .signifi- 
cant. . 

10. Positive changes do not 
occur with equal frequency across 
all prevention projects.. The most 
consistent evidence of positive 
changes in school- level outcomes 
occurs for the Charleston, Puerto 
Rjlco, and Kalamazoo projects. All 
three of these projects are primary 

* prevention projects that focus on 
changes « in the environment, that is 
they are Quadrant 1 projects in 
terms of the* classification pre- 
> ;sented in Chapter 4. They' would 
therefore be expected to have, larger 
effects on school climates than 
would projects focused primarily on. 
a subgroup of the population. In* 
our judgment, the ^Charleston project 
is unter taking thorough efforts to 
systematically implement well-de- 
fined interventions aimed at alter- 
ing the broad school environment,- 
and the Kalamazoo project is also 
clearly focused on broad-ranging 
school climate improvement. The. 
grade structures of the schools in 
which the Puerto Rico project oper- 
ates were changed between 1981 and 
1^982. This reorganization resulted 
in the elimination of split sessions 
and a -decrease in school popula- 
tions. Hiese structural changes, 
are the most plausible explanation 
. for the significant positive find- 
ings for the Puerto Rico schopls. 
The schoc>l that experienced the most 
improvement is. the school that con- 
verted from a 9-12 to a 10-12 'grade, 
structure. Also', most of the signi- 
ficant improvements are on teacher 
measures. The focus of the project 
is on students , not teachers. 
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Creating changes, in the climate 
of schools of sufficient magnitude 
to have substantial effects on the 
incidence of delinquent behaviour is 
bound to be difficult. We interpret 
the eyidence presented in this chap- 
ter as implying that postive changes 
in school climates, including 
changes for known risk faators for 
delinquent behavior and known corre- 
lates of program development, have 
occurred. Significant increases in 
school safety are already, apparent . 
Provided that the implementation of 
prevention projects continues to i 
improve over time, these encouraging 
results suggest that future results 
may be more impressive. 

11, The overall results mask,, 
impressive instances of progress 
within some projects. The evidence 
reported in this chapter, taken 
together with evidence presented in 
more detail elsewhere! (Coo,k, 1.983a; 
D. Gottfredson, 1983) strongly 0 sug- 
gests the interpretation that the 
Charleston and Kalamazoo projects 
are / developing as promising delin- 
quency prevention interventions that 
talce a primary prevention, environ- 



mental change approach . Plans to 
continue to develop, evaluate, dis- 
seminate information about, and 
replicate those projects, should be % 
'made* . 

Epidemiological Indicators vs . 
Between Group Differences 

All of the results presented in 
this chapter are. for school popula- 
tions. Some projects have no sub- 
stantial interventions intended to 
influence the environment of the 
scho9l as !a whole. Specifically, 
some of the ^projects direct their 
activities to preventive or remedial 
interventions with selected groups 
of students.' For such projects,^ 
effects a^e most likely to be evi- 
dent in comparisons of youths who 
receive direct services .with control 
groups. This chapter does no't bear 
directly on the efficacy of inter- 
ventions, targeted at 5 selected groups 
of students. Evaluations' of such 
interventions are discussed in. 
detail in the reports of the evalua- 
tions of those individual projects. 
Highlights from those interim evalu- 
ations are described in -Chapter 6. 
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All of the del inq.uetr.cy prevention 
projects in the Alternative Educa- 
tion Program had at least oj^e proj- 
ect component directed at- an identi- 
fiable target group of • individuals . 
These interventions were diverse* 
Some were directed at a highly 
selected grotip of high risk indivi- 
duals, some were directed at youths* 
more representative of the general 
population. Some involved altering 
the' environment to which the target- 
group was exposed j others involved 
efforts to enhance the- coping skills 
or ability of the individuals to • 
adapt to tjie environment. 

„ We took great paifis to work with 
prevention project implementers to 
develop evaluation .designs that 
would enable us to gage the efficacy 
of the interventions targeted at 
identifiable groups. Our aim was to 
create circumstances that would make 
possible confident contusions about 
the effects of specif ied interven- 
tions, while bearing in mind that in 
the preliminary stages of a proj- 
ect's development rigoroup outcome 
evaluation may be an egregious exer- 
cise. Put another way, there must 
exist a^ reasonably well developed 
and specifiable intervention to 
x evaluate. Furthermore, implementing 
caref ul experimental evaluations of 
field trials is a very difficult , 
undertaking. Some of the difficul- 
ties encountered in. convincing proj- 
ect implementers of the importance 
of bearing the burden of rigorous 
outcome evaluation are described," in 
our first interim report (Ggttfred- 
SQjan 1982c, Chap. 3).. / \ 

It is evident that % good manj& of 
tfie interventions being implemented , 
in- the Alternative Education Program 
remaiain incompletely developed 



v 



form. We perceive steady progress 
in many projects in refining their 
programs over time as they gain 
experience "benefit from evaluative 
' information and from technical 
assistance, and put rudimentary 
ideas to test. It is also evident 
that a good many, of the attempts to" 
implement interventions in this Pro- 
gram have been thwarted by exigen- 
cies beybnd the control of. the 
iipplementer s.' or not foreseen " by any- 
one. In other cases, the project 
implementers do not appear 'to aim 
systematically to dev&lop specific 
interventions but rather to take 
advantage. of opportunities that 
exist in the project's environment 
to achieve the adoption of any inno- 
vation that appears to hold promise 
for moving the school in a desired 
direction. And in some cases,, the • 
resources — time, talent, moaey, 
technologies — required to implement 
what was intended are not available 
in a project." * " 

In short, the prevention projects 
are not only variable in terms of 
the _ocus 'of the interventions tar- • 
geted at identifiable groups, but 
they are also variable in terms of 
the integrity and developmental 
stage of those interventions, and in 
terms of how stable or well defined 
the interventions are. 

Commentators (Farrar & House, 
1983) on the evaluation of Push/fex-v, 
cell, Jesse Jackson'jS highly pub- 
licized effort to inspire youths to 
stay in school and perform well . 
there, have made an interesting sug- 
gestion. Push/Excell may have been 
a movement 'rather than a pro&ram . 
According to Farrar and House, the 
tirovement aspect of Push/Excell was ' 
expressed by a compelling message: 
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"That* hard work, self-discipline, 
delayed gratification, and persis- 
tence were' qual ities that youth . 
needed in ordfer to succeed" (p. 37). 
The movement had a catalyst — Jessie 
Jackson. The program aspect of 
y/Push/Excell was expressed in a set 
f/oi 10 guiding principles, in some 
* suggestions for implementing the 
program, and a skeleton staff that 
provided some (but probably not 
enough) assistance to the implement- 
ing sites. An impl ication we draw 
from this commentary on Push/Excel 1 
and its evaluation is that program 
evaluations may be best suited to 
the evaluation of programs, and not 
all activities' are really programs. 

None of the Alternative Education 
Program's projects,, are movements , 
but some of them do not "resemble 
programs very much, afid they are 
difficult to evaluate, as programs. 
Such projects squirm like v reluctant 
cats when attempts are made to cram 
them into a box. We have judged it 
futile to attempt to encase certain 
aspects of some projects — the effort 
is beyond our resources , and the * 
evaluation would likelV miss the 
point. % 



Evaluation Designs 



For all the foregoing reasons the 
evaluation designs for the compo- 
nents of the 17 prevention projects 
difter. We* had expected that the 
evaluation designs implemented in 
the second year of the Alternative 
Education Prpgijam would be°much 
stronger than they were in the first 
year. They are much stronger The 
timing was better, experience hadr 
been gained in the first year,* and 
everyone had a better ideayDf what 
was required, , \ 

The designs as implemented are 
'briefly described in Table 1 . . True 
experiments involving the random 
assignment of yojitjis to treatment 



and control groups are generally to 
be preferred. Seven of these pre- 
vention projects implemented random- 
ization for at least one of th£ir 
interventions. When randomization 
is impossible or not feasible, the 
use of a comparison group created in 
some other way is necessary. The 
more "equivalent" this 'comparison 
group the better* That is, when a 
comparison is markedly different t 
from the group receiving treatment, 
a host of potential explanations fo 
differences observed in outcome 
measures are possible. The availa*- 
bility of pre-intervention informa- 
tion is often useful either to <■ 
assist in ruling out a hypothesis ; 
t;hat outcomes observed are due to 
pre-existing differences between the 
^treatment and comp&risori grtoups, or 
to increase the e^f iciency (statis- 
tical power) of an evaluation 
desigta. Finally.! sound and compre- 
hensive outcome measures are, 
required to assess the effects of 
any intervention. 



Taking all of these considera- 
" tions together, the projects that 
werq most amen* ble to the interim 
outcome evaluation of their targeted 
interventions ^in the second year of ■ 1 
the Program were those in Compton, 
Chicago (PCI}) , Charleston, and Mil- 
* waukee. Each of these projects 
involved the random assignment of 
youths from a pool of eligibles for 
their major interventions targeted 
at identifiable # groups; each was 
able to develop comprehensive out- ♦ 
~dome measures. The projects located 
in Pasadena, Kalamazoo, Puerto Rico,\ 
the Virgin Islands, MiSuni, and PlyV 
moutfi either implemented reasonably 
strong quasi— experiments for their 
major interventions, or implemented 
true experiments for some project 
components. The highlights pre- 
sented below describe sonie of the 
results for these projects which 
were most "amenable to interith 
assessment of effects. | 
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Table 1 

V • Evaluation Designs for Project Components Targeted 

at Identified Groups 







Control Rroup 




Pre treatment 


Outcome 

Till* A R lit" P A 


Pro j ec t 


r a n d otn 


"on ki i tr n 1 ont* " 
CQU1VU ILIIL 


nonequivalent . measures 


* 

Compton, CACYD 


yes 


■ NA 


NA 


• 

yes 


yes 


Pasadena, STATUS 


no 


yes 


yes 


par t ia 1 


yas 


Chicago, PCD 


yes 


NA 


MA 
MA 


no 


' y e * 


Chicago, CBK 


' par t ial 


no 


no 


yes 


partial 


Kalamazoo, AEP 


a 

. yes 


no 


yes 


no^w 


. yes 


Bronx, PREP 


yes , 


NA . " 


MA 


partial 


i partial 


liar* 1 em, AAEP 


no 


no 


yes 


no 


partial 


Puerto Rico, OC 


no 


no 


yes* , 


yes 








NA 


NA 


yes 


ves 


Houston, OlS 


no 


no 


. 'yes 


n6 


no , 


Virgin Islands, AEP 


no 


no 


yes 


yes 


yes v. 


Hayward, LCO 


no b- 


no 


;^es 


partial 


part ial 


Miami, ACE 


'no 


yes 


■ NA , 


yes 


yes 


Plymouth, AE? . 


yes b 


no ■ 


yes 


# yes 


yes • 


New Jersey, EIC . 


no 


no 


• y es 


partial 


partial 


Milwaukee, MYEC 


"yea. 


NA * 


NA 


yes 


yes 


St. Paul 


no 


no 


yes 


no 


yes » 



a Students who participate^ *in tfie student council were randomly assigned to participate 
within homerooms. The design for other project components is a non-equivalent control group 
^design. „ 

b No control group was available for the Learning Options (Crowthworks) component. The 
designator the middle school treatments was a non-equivalent Control group design. 
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High light s 

In the following abstracts we 
summarize 'some 4 of the major results 

-of the interim assessments of the 
effects of project components tar- * 
geted at specified groups. This 

' account is not comprehensive, and 
readers are encouraged to consult 
the .more extensive accounts pre- 
sented in Part II of this report. 

Compton 

The Compton Action Alternative 
\School (formerly the Compton Action 
Center for Youth Development ^ CACYD) 
has evolved over the course of its 
first two years in ways that appear 
to have strengthened it as a delin- 
quency prevention project. Interim 
results based on student self-report 
suggest that the project has been 
remarkably effective in altering^ a 
number of student charaf teristics 
that delinquency prevention theory, 
implies must be altered' to prevent 
delinquent behavior, and student 
self-reports of delinquent behavior 
are significantly lower than the 
self -reports of 4 a control groiip. 
The self-report data must be inter'-* 
preted with caution, however, 
because of some evidence of differ-.' 
ential validity for treatment and 
control group members.. Problems 
with the retrieval of some archival 
■ data on official delinquency and 
other outcomes limit the assessment 
reported here.- New data have very 
recently become available to 
strengthen the analyses performed to 
•date, and 1 the results^currently 
available should be regarded as ten- 
tative. 

Pasadena 

Project STATUS (Student Training 
Alternatives Through Urban 0 Strflte- 

» gies) involves 5 interventions: ( (a) 
the Options class;, (b) the Youth * ** 
Committee and Leadership Training 

'Class, (c) project .training; (d) 



' parent., involvement , and (f:) the 
Act ion/ Advisory Committee, are 
designed to* provide students with.a-^ 
meaningful educational program. The . 
evaluation ddsigne for the Options 
class and a Youth Committee in one* 
of the two schools involved in this 
project were strong enough to merit- 
description of the interim results 
here. Results show Eliot's Options 
cl'a88 r to significantly decrease '.V^ 
Alienation, increase students" s 
self-ratings of reading ability, 
decrease withdrawals from school, 
increase Interpersonal Competency, 
and increase student reports of the 
Fairness and Clarity of school 
rules. It appears to have the unan- ■ 
ticipated consequence of increasing 
absenteeism for participants i, n the 
class. No' statistical evidence of 
effectiveness was found for Muir 9 
Options class nor for the Youth Com- 
, mittees. Numerous problems in 
implementing the program may par- 
tially account "for th^ null results. 

PCD 

Peer Culture Development (PCD), 
operating in the .Chicago Public 
Schools, runs a peer counseling 
/intervention as regularly meeting 
classes. The interim evaluation 
results suggest that the project has 
produced positive effects on belief 
in conventional rules, delinquent 
behavior, and school grades for some 
subgroups. At the same time, no 
• dependable ev/idence was adduced that' 
other important project objectives 
were achieved, and the effects 
observed are not observed consis- 
tently in each semester and across 
the several ca tegor ies of youths 
involved. Because some interim 
results suggest that the interven- 
tion can be strengthened, the proj- 
ect has actively engaged in clarify- 
ing its implementation standards and' 
developing procedures for monitoring 
these standards. The PCD project 
illustrates a serious approach to 
project development over time. 
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Kalamazoo " 

The Milwood Alternative Project 
is primarily a school Improvement 
project operating in Milwood Junior 
High Schodl in Kalamazoo, Michigan. 
Accordingly the results described in 
Chapter 5 for the^ school-wide out- 
comes x are most relevant to the eval- 
uation of this project. 'The project 
did*, however , havs several compo- 
nents targeted at subgroups of the 
scjiool ' s population. These include 
an attendance monitor ing procedure , 
a Skills Lab class for low-achieving 
s tu den t s , a schoo l'-wi th in-a- s cho ol 
fo^ eighth grade students (the Mil- 
wood Alternative Program), a student 
council, and a- project advisory. 
'One of these components ,. the student 
council, was amenable to outcome 
evaluation through the fortuitous 
use of a lottery in homerooms to 
assign students. to participate. 
Results suggest that involvement in 
the student council may have 
increased Negative Peer Influence, 
lowered Self-Concept, lowered 
Attachment to Parents, reduced stu- 
dents' perceptions of Parental 
Emphasis on Education, and lowered 
educational expectations. A number 
of alternative hypotheses to explain 
these results also exist. 

A second component, attendance 
monitoring, resulted in , a signifi- 
cant reduction in the proportion of 
students who could be considered 
"chronic non-attenders* 1 when com- 
pared to a similar group of students 
in the Kalamazoo comparison school. 

Puerto Rico y 

The Puerto Rico project, run by a 
community organization, functions as 
an extension of the school day. 
Project staff work cooperatively 
with school administrators and 
faculty to assess student academic 
needs and schedule project activi- 
ties. .The' project includes an aca- 
demic component and activities aimed 
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at student social development and 
community participation. The evalu- 
ation uses a non-equivalent control 
group design with good pr e-interven- 
tion data available for use aa sta- 
tistical controls. Interim evalua- 
tion results suggest that the 
project has modest positive effects 
on school grades, students' educa- 
tional expectations, standardized 
achievement te 3t scores, studGnts' 
Involvement in extracurricular 
activities, and Student Influence. 
Some negative results are suggestive 
of negative outcomes for students 
referred to the project for academic 
difficulties, but these results may 
most plausibly be regarded as due to 
weaknesses in tt^e evaluation design 
for this pa rt icular project compo- 
nent • 

Charleston 

Project PATHE operates in seven 
Charleston County Public Schools. 
It aims to. alter broad aspects of 
school climate and to assist in the 
adaptation of a group of approxi- 
mately 100 high risk youths in each 
school. Implementation data show 
substantial variability in the 
strength of implementation of the 
direct service components across the 
seven schools. Schools that were 
implementing the school-level inter- 
1 ventions in strongest form tended to 
be weaket 'in implementing the inter- 
ventions targeted at high ri.sk 
youths. The evaluation involves a 
large js^mple true experiment. 
Interim results suggest that the 
PATHE program increased academic 
performance for targeted individuals 
at both the middle and high school 
levels, and increased school at ten- 
dance , promoted attachment to school 
and enhanced self-concepts for tar- 
geted middle school stildents. In 
one or more of the* middle schools 
significant positive, effects were 
also found for the following out- 
comes:' serious delinquency, rebel- 
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1 iouH autonomy, individual student > 
percept ions of the fairness and 
clarity of the fichool rules , scF&ol 
punishments i and employment. That 
is, treatment group students 
reported less serious delinquent 
behavior and rebellions autonomy 
than did control group studentB, 
reported the rules to be fairer and ^ 
clearer, received less punishment, 
and were employed more often. In 
one of the middle schools treatment 
students scored significantly lower 
on the measure of Practical Know- 
ledge than did control group stu- 
dents , and in a high school several 
negative effects were observed for 
the target group students: £chool 
Attachment, edacational expecta- 
tions, and employment were lower for 
treatment , than for control group 
students. 

Virgin Ts lands 

The Virgin Islands Alternative 
Education "Project is seeking to 
implemert two interventions dissemi- 
nated by th£ National Diffusion Net- 
work (NDF) — Focus and PAH. Interim 
evaluation results suggest that 
Focus is being implemented largely 
afi intended, but with some modifica- 
tions jto the Focus model. PATL was 
not implemented ' as Intended- in the 
second year of project operation. 
Despite some weaknesses in the eval- 
uation design and measures, results 
suggest that the modified Focus 
intervention resulted in students 
receiving higher grades thati they 
otherwise may have received.- No 
other consequences of the Focus 
intervention were detected by the 
evaluation* Program development is. 
continuing, as are efforts to 
strengthen the evaluation. 



Mi^mi 

The Academy for Community Educa- 
tion is a small alternative school 
that uses a token economy system, 
academic education, prof ess tonal /vo- 
cational curriculum, and other 
interventions in providing services 
to youths at high risk of delinquent 
behavior drawn from the Dade County 
(MiamiT Public Schools. The limited 
data currently available suggest 
that participation in the Academy 
results in significantly less absen- 
teeism , fewer suspensions , less tar- 
diness to school, and more academic 
credit earned than participation in 
the public schools. Academy parti- 
cipants, however, withdrew from 
school involuntarily more often than 
similar students remaining in the 
public schools. Despite some import 
'tant limitations of the data, these 
interim results are encouraging. 
r. 

Plymoufrh 

The Plymouth Alternative Educa- 
t ion Project operated Student Ser- 
v ice Centers, Student Activities 
Centers, and an out-of-school Learn- 
ing Options program primarily for 
two high school's and two middle 
schools. These interventions pro- 
vide educational services, counsel- 
ing, and recreation for students 
with disciplinary and attendance 
difficulties in this predominantly s 
working and middle-class white com- 
munity. Interim evaluation results 
raise some questions about the Stu- 
dent Service Center implementation, 
and sugge st that some unexpected 
negative effects of this counseling 
intervention may be occurring. Spe- 
cif ically, treatment students as 
compared' to controls reported fess 
Interpersonal Competency, lower 
Self-eBteem, more. Rebellious Auto- 
nomy, less Involvement in conven- 
tional activities, lower Attachment : 
rto School, and less Parental Emphsa* 
sis on Education-* 
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Interim evaluation results imply 
that the high school Student Activi- 
ties Center is being implemented 
with care, and has some promising 
positive effects on participants. 
Specifically, the SAC Students 
scored significantly higher than 
their controls on tests oi writing 
skills and Practical Knowledge, and 
report higher tichool gVadqs and less 
alienation. 

The Learning'Options program did 
not participate in an outcome evalu- 
ation. 

Milwaukee 

The Jewish Vocational Services 
Alternative Education Project devel- 
oped and implemented three interven- 
tions. The Milwaukee Youth Employ- 
ment Center (MYEC) counseled dropout 
y> uth and attempted to place them in 
employment. The Return Center, 
operated in cooperation with the 
Milwaukee Public schools, assessed 
and referred to alternative educa- 
tional programming youth who were 
contemplating dropping out, or who 
had already dropped out and wished 
to re-enroll in formal education. 
The Job Score class was a regular 
high school course developed by MYEC 
staff to teach employment skills to 
youth at' risk for dropout. 

An experimental evaluation of the 
MYEC program indicates that it was 
not successful in increasing the 
employment opportunities of its 
clients. No evidence exists that 
the Psychological Health, Interper- 
sonal Competency, or Rebellious 
Autonomy of the youths involved were 
affected by- the program\ Subsidiary 
analyses suggest that in general, 
clients did not receive many ser- 
vices, although the extent to which 
clients participated in the remedial 
education provided through the proj- 
ect was .associatedywith positive 
outcomes. Evaluations of two. proj- 
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ect component s-~ the Return Center 
and Job Score cl asseH--were not com- 
pleted due to the early termination 
of the project . 

A Su mmary 

The foregoing list of highlights 
may be difficult for the reader to 
integrate. Accordingly, in Tables 2 
and 3 we summarize these highlights 
in tabular form to provide a sort of 
M box score 11 for the program as a 
whole . TTi is summary , for *n terven- 
tions targeted at specified ^ oups 
of individual 8 , parallels t « sum- 
maries provided in Chapter (Tables 
1 through 3) of overall r< rs for 
interventions aimed at en >opu~ 
lations. 

These tables summarize the ev i- 
dence about the effects of targeted 
interventions on the characteristics 
of individua Is — their psychosocial 
characteristics and their .behavior . 
Only the goals and objectives men- 
tioned in the OJJDP program 
announcement and selected delin- 
quency risk. factors are included in 
this tally. Other project-specific 
goal s and obj ectives are spme times 
omitted. In a few cases, however, 
where a specific hypothesis that 
individuals targeted by the project 
would have different perceptions of 
their environments, some of the 
environmental objectives have been 
addressed by measurement of the per- 
ceptions of treatment and comparison 
groups ind ividual perceptions; some 
of these comparisons are included in 
these tables . 

A box score for the Alternative 
Education Program's goals is pre- 
sented in Table 2..^ The preponder- 
ance of the sign if icant effects of 
these targeted interventions is 
posi tive. Of 23 significant differ- 
ences, 20 were in the positive 
direction. Two of s the three nega-- 
tive outcomes were for subcomponents 
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Table 2 



Number of Alternative Education Program Projects Showing 
^ /Experimental or Quasi-Experimental Evidence of Effects of 
Interventions Targeted at Specified GrSups : Program Goals 



Measure 



Number of Alternative 
Education Sites, 

Positive Negative 



Decrease Delinquent Behavior 
. Ifi and Around School 
♦Serious Delinquency 
Drug Involvement 

•f r 

Decrease Suspensions 
Increase Attendance 



3 
1 

2 

3 



0 

-0 

Q 
. o 



Increase Academic Success 



Grades 

Standardized test scores 



Improve Transition to Work and 
Post-secondary* Education 
<g» Educational Expectations 
Working for' pa? 

, . Having a jab 



6 
2 



0 
0 



1 
0 



Note . Only the ten projects' having sufficiently rigorous outcome 
'evaluations. of targeted interventions to warrant interpretation 
•are included in this table. Measures or goals come primarily 
from the School Action Effectiveness Surveys, but are also taken 
f*bm official school or police records when available. 
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Table 3. 

Number of Alternative Education Program Projects Showing 
Experimental or Quasi-Experimental Evidence of Effects of * 
Interventions Targeted at Specified Groups: Program Objectives 



Number of Alternative 
* ' Education Sites 

Measupe x Positive Negative 



Making* School Discipline Fair and Consistent 
While Providing for Due Process 

Students' Reports* of Clarity of Rules 2 0 

. ' Students' Reports of Fairness of Rules 2 0 

Increasing Youth, Parent and Community' Agency 

Participation^ in School Decision Making to 

Reduce Student Alienation ^ 

Students' Reports of Student Influence 1 0 

Alienation 2 1 

Preclude Labeling Effects 

Positive Self-Concept 1*2 

Provide a Learning Structure Tailored to 

Realistic Levels to Promote Educational * , 
and Social Development 

Rebellious Autonomy 2 * 

Practical Knowledge 2,1 

'Interpersonal Competency 1 1 

Parental Emphasis on feducation 0 2 s 

School Punishments * 1 2 

School Rewards . 2 .0 

Additional delinquency risk . 
risk factors ^ 

Attachment to Parents 11 

Attachment to School - « 2 1 

Belief in Rules - 2 0 

Negative Peer Influence 0 1 



Note . Only the ten projects having sufficiently rigorous outcome 
evaluations to warrant interpretation are included in this table. 
Measures of objectives are taken from the School Action Effective^ 
ness Surveys. . . ' 
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of projects with largely positive 
effects. Because so many statisti- 
cal tests were performed, some of 
these nominally significant differ- 
ences could occur by chance, but by 
chance half would be expected to be 
po-sitlve and half negative. That 
result was not observed; 

A box score for significant dif- 
ferences for measures of Alternative 
Education Program objectives for the 
targeted interventions is prov ided 
in Table 3. Of 34 significant dif- 
ferences, 21 are positive and 13 are 
negative . Once again, 5 of the 13 
negative effecjts are for subcompo- 
nents of projects with largely posi- 
tive findings. Of. the negative 
finding^, six are for a single proj- 
ect, reflecting what appears to be 
an unexpected negative influence of 
a counseling intervention run by 
that project (Cook, .1983). 



Progress 



q The results presented here and in 
the previous chapter imply that pro-~ 
gress has been made not only in 
implementing" the interventions con- 
ducted by the projects in the Alter-, 
native Education Program, but also 
in implementing the evaluation of 

^ those projects. The experimental 
and quasi-experimental evaluation of 



these pro je~~ct^t_o_date provide evi- 
dence that we interpt^t^as suppor- 
tive of this general approach^to 
reducing youth crime. These are 
interim results for projects that 
continue to develop , however. Most 
of these projepts are being imple- 
mented in improved, form in the third 
year, and evaluation designs and 
data collection arrangements are 
improved. As these projects 
develop, use information about their 
effects and about the strength and 
integrity of their interventions, 
benefit from technical assistance^ 
and gain in experience and expertise 
they may .be expected to produce 
stronger and more consistent 
t effects 

The evaluation has turned a 
greater' portioti of its effort to 
documenting the implementation of 
interventions and to working with 
project^ to clarify the standards 
for the impleipentation of tifeir 
project^.' This effort, too, may 
contribute not only to stronger 
interventions for some projects in 
the third year, but also 'to the 
efforts of others who follow these 
projects in ef f or ts to implement 
effective delinquency prevention 
programs- by using the program models 
being developed. 
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Educational Interventions and the Prevention of Delinquency": Some Closing 

Observations 



Some observations on the Alterna- 
tive Education Program at the end of 
two years of operation are apt. In 
this final brief chapter we offer 
some of our less itechnical observa- 
tions on the operation of the Pro- 
gram, and some observations on the 
implications of what._we have learned 
'so far for the futtire^f delinquency 
preventiorf. A shortage of time, and 
the pressure to get 6n with the task 
of continuing the evaluation in the 
third year limit our ability to 
carefully document and justify the 
opinions expressed here. Intetead, 
we assert our opinions &nd will 
leave to a later date a fuller expo- 
sition of these opinions and specu- 
lations and" of the. reasons we 
believe as we do* 
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. The Alternative Education Pro- 
gram's inception was based on a 
background of research and careful 
thought about the causes of youth 
crime. The background paper that 
spelled out the rationale for an 
Alternative Education Program 1 
(OJJDP, 1980) was a careful document 
that built a good case for educa- 
tional, and school structural, 
approaches to reducing the risk of 
youths crime. A President's , Tasl$ 
Force "(President's Commission on Law 
Enforcement and Administration of 
Justice, 1967) had pointed to causes 
of delinquency in the organization m 
of schooling in America. A National 
Academy of Sciences panel (Martin, 
Sechrest, & Redner, 1981) called for 
research and development of school- 
based interventions for both primary 
prevention and remediation at about 
the time the Program was initiated. 
We have elaborated elsewhere a 
strong case for interventions in 



schools to prevent delinquency 
(Gottffedson & Daiger, 1979; Gott-v^ 
fredson, 1981; Gottf redson', 1983b). 
The evidence of the present evalua- 
tion provides no reason to 'question 
the scientif ic,_ theoretical, and 
practical premises upon which the 
Alternative Education Program was 
based. To the contrary, ^patterns we 
see in the data provide every reason 
"to' try harder to implement and eval- 
uate preventive interventions based 
on this approach. Oncejagain, for 
example, we find the same school-re- 
lated risk factors' associated with 
delinquent behaviqr (see Chapter 4). 
More impressive,* the evaluation has 
Droduced experimental evidence that 
interventions in schools can alter 
some of these risk factors and^even 
evidence suggesting that delinquent 
behavioj* ha,s been reduced. 

* . I 
i Developing Effective Programs 

■/ ' 

The most pressing |problem in the 
delinquency prevention' field is the 
problem of developing sound, theory- 
based interventions that can be 
implemented in strong enough form 
that they will make fa substantial 
contribution to' the /reduction of 
delinquent behaviorL The develop- * 
ment and implementation of strong 
programs is not a need of alterna- 
tive educational approaches to 
delinquency prevention alone. Such 
development and careful implementa- 
tion is required in every approach 
to del inq ue n cy pr e'v en t i on . It is 
required in the erltire. criminal anc 
juvenile, justice area* Programs to 
rehabilitate of fenders have been/ 
alleged not to woirk (Martinson^ 
1974)o But the ^ctual evidgnc/e sug- 
gests that few rehabilitative 
efforts of sufficient strength and 
bfcen implement* 



integrity have bi 
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carefully evaluated, that the task . 
of creating such interventions will 
be difficult, and that we should try 
harder (Sechrest, White, & Brown, 
1979). The development, implementa- 
tion, and evaluation of such more 
effective programs will require the 
attention of talented people in a 
concerted effort over a period of 
years. A more careful, long-term, 
technologically and scientifically 
based programmatic effort ,mUst be 
Tnade to realize the potential to 
reduce youth crime that there is now 
every scientific reason to believe 
exists. A two- or three-year pro- 
gram with limited scientific and 
technical assistance is not enough 
time to demonstrate that this poten- 
tial can be realized. 

Sound Implementation 

c 

Throughout our earlier -report, 
and in the present one, we have 
emphasized the importance of 
strength and fidelity in the imple- 
mentation of prevention projects. 
Indeed, we attempted to structure 
the evaluation in ^ays that would 
foster the development of strong 
interventions with high probability 
of implementation. We are gratified 
by what we "perceive to be great 
strides in strengthening the inter- 
ventions implemented by many of 
these projects. In our judgment, 
however, every one of these projects 
can improve greatly in the strength 
and care of implementation of its . . 
interventions. This is 'not a .con- 
demnation, far from it, for we note, 
with favor the progress that has 
been made . ' 

The point is that a number of 
available technologies fhat appear 
to fit with the goals, objectives,, 
and rationales behind these projects 
are used far, far less than they 
could be. Classroom reward struc- 
tures that have been experimentally 
demonstrated to alter known delin- 
quency risk factors (attachment to 



s chool , performance in school) are 
being used in only one project, and 
there not in thorough or strong 
form. Home-based reinforcers are 
not be ing systematically applied, 
despite their demonstrated efficacy 
in altering another delinquency risk 
factor (disciplinary' difficulties in. 
school). Technologies that involve 
behavioral contracting and the care- 
f ul consequation of behavior are 
underutilized in all but perhaps one 
of these projects. 

One reason, no doubt, that some 
of -the existing technology goes 
underutilized are difficulties in 
creating productive organizational 
change that will lead to their- adop- 
tion. Another reason, no doubt, is 
that insufficient attention has yet 
been directed to ensuring that these 
technologies are available fo proj- 
ect implementers and that they have 
the skills to' implement them. A 
third reason, probably, is that we , 
have not taken seriously enough as a 
nation the development of a cadre of 
professionals expert in the applica- 
tion of such technologies, and that 
a human resources development effort 
will be required to implement educa- 
tional and delinquency prevention 
projects in strong form. And a 
fourth reason, we are certain, is 
that the jolting way in which pro- 
grams are begun and ended, to be 
started r and stopped again at some 
later time 1 ; in some other place, 
with some other personnel,' is not 
conducive to the development of 
strong programs. 

We must pursue our goals syste- 
matically if we are to achieve them. 
» * 

Evaluation and .Expertise 

We will make more progress * 
towards the development of sound 
delinquency prevention programs when 
everyone involved adopts an experi- 
menting approach to the .enterprise. 
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F<^r too many years, and there is 
only , the slightest sign that this 
attitude is eroding, an attitude ofi 
"anything goes" has pervaded the 
administration of most programs in 
the crime prevention area. Propo- 
nents of correctional reform, of 
school reform, of reform in the 
juvenile and criminal justice system 
more broadly, have always felt free 
to condemn the existing system and 
offer .their alternatives. Seldom, 
indeed, do proponents of reform pre- 
sume that their reforms may also 
introduce undesirable effects not 
anticipated in advance*, that their 
reforms may founder on unforeseen 
obstacles, that they will one day be 
the target of future reformers who 
will condemn them, 

' Virtually every innovation in the 
criminal and juvenile justice sys- 
tem, and* in the educational system, 
should be approached as an. experi- 
ment. The reason , { simply put, is^ 
that the innovations may, not help, 
may not help as well as expected, or 
may cause harm. 

We have encountered resistance to 
evaluation of interventions in one 
form or another from many sources in 
the conduct of our work. A.project 
implementer may be sure his or her 
intervention works and eschew the 
burdensome activity of studying the 
intervention's effects. .A project 
director may wish to avoid rocking 
the boat in his or her system and 
avoid steps to make available the , 
necessary information or arrange- 
ments to make for a maximally useful 
evaluation. A project officer may 
see a need to rapidly meet service- 
quotas and create an environment not 
conducive to an orderly evaluation. 
The pages torn from the calendar 
each day create a pressure to get on 
with the work, now, rather than to 
plan and systematically carry out e 
the most careful possible implemen- 
tation and research. 



We interpret some of the evidence 
and experience generated by this 
evaluatidri as implying a need for 
greater expertise and for a tho- 
rough-going experimental approach t6 
delinquency prevention. ' We are 
disheartened when we see a project 
rapidly staffed with workers not 
fully qua 1 if ied by experience or 
training to implement their parts, of 
a project. • We waste precious time 
and resources when we mus,t wrangle 
with recalcitrant -implementers over 
whether or not a project component 
should be evaluated. 

The heed for expertise and an 
experimenting approach to the devel- 
opment of delinquency prevention 
projects is obvious, and should' be 
insisted upon. For example, the 
negative or mil 1 results for some o£^ 
the counseling interventions 
included in the Alternative Educa- 
tion Program strongly imply that no 
such program should be undertaken 
without the firm guarantee in 
advance that the intervention will 
be undertaken as an exper iment and" 
with highly qualified staff. 

The Work Ahead 

We have only begun to explore the 
wealth of information about the 
effectiveness of the Alternative 
Education Program and its component 
projects. Nested withyn each of 
these' projects lie unmined treasures 
, of inf orma'tiQti about; the relative 
efficacy of each of the interven- 
t ions implemented. In the third 
year of the Progr.am projects are , 
implementing interventions of 
greater strength than those of the 
second year, and the arrangements to 
evaluate thenv aire Siounder . We will 
continue our efforts to unearth - 
these treasures as the evaluation 
continues . This report is an 
interim evaluation. More powerful 
and more thoroughgoing analyses 
remain, to be performed; there is 
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much more to learn about this written. oyly after much remaining 

Program. The final chapter will be work is completed. ^ 
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Resulting 



from the Evaluation 



Here we provide a" partial listing of written products produced in the 
course of this evaluation. ■ the most important previous written product is our 
first interim report (G. D. Gottfredson (ed.), The School Action Effectiveness 
Study; First x Interim Report . Baltimore; The Johns Hopkins University, CSOS, 
1982). - That report contained an overview of the Alternative Education Pro- 
gram, the • Schdol . Action Effectiveness Study, and a description of each of the 
17 projects in the Prdgram. 

The following table contains a partial listing of other written products 
produced during the course *,of the evaluation . 




Products 



Table 1 



Selected Writt^p Products Resulting from the , Evaluation 



Project 



topic or Title 



Date 



Compton 



Report on /at tendance and 
behavior outcomes for 
Fall Semester*, 1981 



February, 1982 



-School cl imate assess- 
ment 



August, 1982 



Constitut ional Rights 
Foundation 



Report pn Fall 1981 pre- 
test . survey 



October, 1981 



School cl imate' assess- 
ment 



August, 1982 



Report on achieve;fcent, 
behavior , , and attendance 
outcomes for 1981-82 
school year 



October, 1982 

• } 



Report oil pre-treatment 
data for 1982-83 experi- 
mental groups 



March, 1983 



Peer Culture Development 



Report' on types of stu- May, 1982 
'dents in peer groups 



PCD effectiveness ass- 
essment; for Fall Semes- 
ter, 1981 



May, 1982 
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Table 1 (continued) 



Products 



Project 



.Topic or Title 



Date 



/ t - 1 

Peer Culture Development School climate assess- August, 1982 

(cont.) * ; f 4 mfeitt . 

*..,.>.J Presentation on PCI^ March, 1983 

1 y effectiveness at recep- 
tion for CBE admini'stra- ^ 
tors, Chicago juvenile 
judges, and school prin- 
cipals / 

Peer Culture Development: May, 1983 
Second/ Interim- Report 

f 

Kalamaaoo , School climate assess- August, 1982 

men t v 

( 

Report on t Line expendi- December, 1982 
ture of project manager t 

Bronx Report on Parent 3'uesti- February, 1982 

onnaire results 



\ 

V 



I ■ ■ 

Report on. behavior and February, 1982 

attendance outcomes for * «« 
' Fall Semester, 19 81 

b * '\ ' 

o Report on Fall 1981 pre- February, 1982 

test survey 

School climate assess- « August, 1982 
men t 



Puerto Rico School climate assess- August, 1982 

ment 

Presentation^ Otro November, 1982 

. . Camino implementation 
and effectiveness pre- 
sented to Puerto Rico 
Department of Education 
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Table 1 (continued ) 



Pro jec j: 



Topic or Title 



Date 



Charleston 



Report on reliability of June, 1981 
CTBS subscales 



J Reports on attendance , 

achievement and behavior 
outcomes for Fall Semes- 
ter, 1981 



March, 1982 
May, 1982 



Report on intensity of 
PATHE interventions 



March, 19 82 
May, .1982 



Bar charts showing 
school level change and 
target-control student 
comparisons for all 
goals and objectives 



October, 1982 



Report on resul ts of 
Parent Questionnaire 



August, 1982 



School cl imate assess- 
ment 



August, 1982 



Report on behavior out- 
comes for first quarter, 
1982-83 school year 



December, 1982 
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Table 1 (continued) 



Project , Topic or Title Date 



Houston School cl imate assess- August , 1982 

ment 



The George I , Sanchez 
Alternat ive Education 
Project,: Second Inter im 
Report (Unpublish^l 
manuscript. San Raphael: 
Social Action Research 
Center) 



March, 1983 



Lac Courte Oreilles 



Report on ef feet of 
PLATO on psycho-social 
attitudes from Fall 1981 
survey and data 



March, 19 82 



School cl imate as sess- 
men t 



August, 1982 



Miami 



School cl imate as sess- 
men t 



August, 1982 



Report on achievement, \ February, 1983 
attendance, * and behavior 
outcomes for Fall Semes- 
ter, 1982 



Academy for Community March , 19 83 

Education : Second 
Interim Report (Unpub- 
lished manuscript:. San 
Raphael : Social Action 
Research Center) 
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Project 



Tabic I (continued) 



Topic or* Title* 



• r. a 



Date 



Plymouth 



Report on attendance, 
achievement and behavior 
outcomes for Kal 1 Semea- 
tor, 1981 



January , 1982 



School climate assess- 
ment 



August, 1982 



Report on utility for 
diagnosis of student 
Behav ioral Evaluation 
Scales 



April, 1982 



New Jersey 



Presentation of effec- 
tiveness of program to 
superintendents and 
principals of South Jer- 
sey Schools 



October, 1982 



Report on- attendance, 
achievement , and behav- 
ior outcomes for Fall 
Semester, 1981 



May, 1982 



School climate assess- 
ment 



August, 1982 



St, Paul 



School climate assess- 'Fall, 1982 

ment 



Project Together : jj.ee- March, 1983- 
ond Interim Report 
(Unpublished manuscript. 
San Raphael: Social 
Action Research Center ) 



Milwaukee 



Report on effectiveness 
of Job Score Class 





June, 1982 



» » 



-122- 135 



Tab It? 1 (continued ) 



Project Topic or Title Date 



Alternative Education Standards for program 1983 

Initiative devlopment eva iuation 

plans (Unpublished manu- 
script. Baltimore: Cen- 
ter for Social Organiza- 
tion of Schools) 



The School Action Effec - 1982 

t iveness Study ; Over - 

viey (Paper presented at 

the annual meeting of 

the American Educational 

Research Association, 

New York) 



The School Action Effec - 1982, 
t iveness Study : Prelim - 
inary Results (Paper 
presented at the annual 
meeting of the American 
Educational Research 
Association, New York) 



The School Action Effec - 1982 
t iveness Study : Devel - 
oping and evaluat ing 
prevent ion efforts . 
(Hapex— presented- at— the -— — 
annual meeting of the 
, American Society of Cri-, 
minology , % Toronto ) 



The School Action Effec - ' 1982 
t iveness Study : First 
Interim Report (Report 
No. 325). Baltimore: 
Center for Social Organ- 
ization of Schools. 
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Glossary 



Glossary 



Administrative 
removal 



Removal from school for a period of one or more 

days as a result of an admin is tr at ive dec is ion , without 

being dropped from the school rolls. In most # cases this 

is equivalent to the colloquial use of -the wordsuspen- 

sion. 



Adoption 



The acceptance and use of a developed program, interven- 
tion, or set of interventions. 



Alternative 
education 

Analysis of 
variance 



Behavioral 
contracting 

7 

Comparison group 



Control group 



Control theory 



Core data 



Critical benchmark 



ERLC 



Del inquent 

/ 

/ 

/ 



Educational prac tices , forms , or structures that 

d if f er from traditional practices , forms or structures . 

A statistical technique used in the analysis of 
experimental data. It's application in quasi- or non-ex- 
perimental da ta is of ten misleading. 

A form of intervention involving an agreement 

among parties about the aim of the intervention and the 

consequences of achieving or not achieving the aim. 

A group of individuals, schools, etc., with which a group 
rece iving some intervention are compared to help learn 
about the effects of the intervention. Equivalent compar- 
ison groups (i.e., groups where no pre-existing differ- 
ences are present) are preferred to comparison groups known 
to be non-equivalent, and equivalence is best achieved 
through randomization (see randomization). 

A group of individuals, schools, etc., with which a treat- 
ment group i"s compared, and which is known to be equiva- 
lent. Control groups should be cr'eated through randomiza- 
tion when possible. 

A theory of delinquency that assumes people will engage in 
unsocial ized behavior unless restrained. It specifies 
gome ways to restrain youths from delinquent behavior. 

Information about the results sought as outlined in the 
Alternative Education Program Announcements/and the inter- 
ventions specified in the program announcement . 

i 

A key decision, agreement, action, or arrangement neces- 
sary, to move forward, with a strategy or plan. If a bench- 
mark is not met, progress in executing the strategy is 
blocked. When a benchmark is met, the forcefield changes. 
A benchmark statement tells what change in the forcefield 
must occur by when. 

Behav ior which is il legal . Includes some behavior 

' ' ' . .143 ' . 
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Glossary 
behavior 

Design decision 



Deterrence theory 



Differential 
association 



Diffusion 
Dissemination 

Evaluation 



Experiment 



Goal(s) 



Forcef ield 



(such as alcohol consumption) that is not illegal -for 
adults . 

The choice of interventions that occurs at or near the end 
of the initial planning phase of project development. 
Design decisions should be reconsidered periodically using 
information about the decision's outcomes. 

A theory that assumes crime can be reduced by the threat 
of punishment. 

A theory of delinquency that assumes people , engagV 
in delinquent behavior because they learn definition^ 
favorable to law violation from those with whom thfcy asso- 
ciate. ' . 

The spread of knowledge or information. 

A set of activities consciously designed to encourage the 
utilization of knowledge or techniques in the development^ 
'or redesign of programs. 

Activity to determine what happened, why, and with what 
effect. Evaluation determines whether project activities 
produced any outcomes of importance; whether unintended as 
well as intended outcomes were produced. Evaluation sub- 
sumes both formative and summative evaluation. 

An experiment is activity undertaken deliberately to exa- 
mine the consequences of the activity. The tejnn experi- 
ment is often used to refer to true experiments, involving 
randomization (see randomization, true experiment). 

What an organization is trying to achieve. A goal gener- 
ally the obverse of a problem; it specif ies . how the goal 
(or the level of the problem) may be measured . Goals are 
not broad or general aims. Such broad or general aims may 
be called missions. 

The social-psychological field that immediately surrounds 
a decision or action. It includes the forces that compel 
or restrain against alternative actions as thev are per- 
ceived by an individual or corporate actor . Organizations 
are held in place (do not change) because forces are in 
equilibrium. To create change, „the balance of perceived 
or actual forces must be* changed. 
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Glossary 



Formative 
evaluation 



Implements ion 



Implementation 
manual 



Implementat ion 
s tandards 



Incapacitat ion 

Institutional- 
ization 



Intervention 



Involuntary 
withdrawal 



Labelling theory 



Management 
^information 
system 



^ptivity undertaken during the course of a project 
to foster project development by determining what is being 
implemented, by whom, with what effect, and/how effective- 
ness may be enhanced. 

The execution of an intervention. Interventions vary in 
the extent to which they are implemented as anticipated or 
planned. 

A blueprint for the implementation or replication 
of an intervention or set of interventions (i.e., program 
model). Such a manual include s a statement of (a) what, 
the intervention is intended to achieve, (bKthe theory 
underlying the intervention, (c) the resources required 
for impTefttentatiort , (d) the training and personnel 
required, (e) detailed specification of the intervention, 
( f ) implementation standards , (g ) al 1 forms and record 
keeping procedures required to operate an,d evaluate the 
intervention. ■ 

A clear statement of indicators of faithful implementa- 
tion (fidelity and completeness) of an intervention. Spe- 
cifications or blueprints for an intervention define the 
t implementation standards for the intervention. 

A theory that assumes crime can be reduced by locking up 
people who' have engaged in delinquent behavior. 

Institutionalization occurs when an , 
activity becomes routinized and part of the status quo in 
an organization. When an activity is institutionalized^ 
more effort is required to. terminate it or substantially 
modify it than i^ required to continue r ,it . 

Activity undertaken to achieve an objective. Intervention 
is often synonymous with .the word "treatment. 11 

Removal from the school rolls 

as a result of an administrative decision. In most* cases 
this is equivalent to tire colloquial use of the word 
expulsion. 

A theory of ' delinquency that assumes that treating an 
individual as «though he or she were a delinquent results 
in the development of a delinquent self-concept and subse- 
quent delinquent 1 behavior.- 

9 

A tool used in formative and summative evaluation 
to provide information about plans , strategies , 
resources, obstacles, adoption, implementation, and out- 
comes. 



9 . 



145 



/ 



ERIC 



-133- 



Glossary 
Management plan 

Mean 

Needs assessment 



A X plan for implementing an intervention or set of inter- 
ventions. A management plan is composed of strategies for 
adoption of innovations (see strategy) and of standards 
for the implementation (see implementation standards). 

An arithmetic average. 



Activity 
tives . 



itended to specify or clarify goals or^objec- 



Posjt-randomization Activity to determine whether, randomization achieved 



check 



Objective(s) 



Obstacle(s) 



Organizational 
diagnosis 



Powerful 
evaluation 



the equivalency of a treatment andL control group by com- 
paring characteristics of the two groups that existed 
prior to the initiation of the intervention, or which the 
intervention coulcl not plausibly influence. 

An outcome that a project's theory of action implies must 
occur to achieve a goal. Objectives ^intermediary out- 
comes) are stated in measurable terms . Ideally, a state- 
ment of an objective will specify when an objective will 
be achieved and how much improvement should occur as well 
as specifying how it is to be measured. 

Forces which hold 'the project back, impede the progress of 
a plan, or move the organization or individual in a direc- 
tion opposite the intended direction. Obstacles may be 
perceived when none exist, or, obstacle s may exist wjiere 
none are perceived. 

Activity designed to assess the current 

status of an organization and the relations among its ele- 
ments,. Organizational diagnosis may include any of the 
following activities: (a) climate assessment, 
(b) assessment of goal confluence, (c) assessment of 
authority and decision structure?, (d) assessment of com- 
munication and interpersonal relations, and (e) assessment 
of the match between goals and activities. Diagnosis 
attempts' t#* interpret the interaction among the above ele- 
ments at a point in time. 

An evaluation with sufficiently sensitive measures, 
adequate sample size, and with a design making the detec- 
tion of intervention effects likely. Evaluations differ 
in power, and ail evaluation lacking in power has a low 
probability of demonstrating anything conclusively. 
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r 



Glossary 



program 

Development 

Evaluation 



Re sour ce 



Rigorous 
evaluation 



A theory-ridden method of action research involving 
goal specif ication , theory elaboration, objective 
development , intervention definition, forcef ield analysis , 
the development of management plans, and evaluation 
research . PDE is intended to result in an upward spiral 
of activity leading to greater organizational ef fective- 
ness in accomplishing its goals. 

Any tool or force that furthers the adoption of an innova- 
tion, implementation of an intervention, or the achieve- 
ment of a goal or objective. A resource may be a person, 
institution, physical or psychological force, information,' 
money, or expertise. Both perceived and unperceived 
resources may exist. 

An evaluation in which one may have confidence in the 
inferences drawn about the consequences of a demonstrably 
implemented and well-described set of interventions. 
Rrgorous evaluation is a major goal oi ^hool Action 

Ef f ect iveness Study . 



Risk factor 



Signif icance 



Site-specific 
data 



Social learning 



A characteristic known to be associated with an outcome 
(e.g., delinquent behavior). Poor school performance is 
one of the risk factors for delinquent behavior. 

A technical term meaning that- the outcome was unlikely to 
have arisen by chance. 

Information about goals, objectives, and interventions 
in each prevention project, whether or not these results 
or interventions are suggested by the OJJDP ^program 
announcement or delinquency theory . It includes informa- 
tion about needs, goals, forcefields, strategies, .inter- 
ventions, and outcomes. 

A th'eory that assumes people behave as they do because 
they have learned about the consequences of behavior 
through their own experiences and obser vat ions of others. 



Standard deviation 



Strategies 



A measure of the extent to which individuals, schools, or 
other units are dispersed around the mean. A measure of 
dispersion useful -in statistical analyses. 

Plans. Strategies ate developed from a forcef ield analy- 
sis. An executable strategy will appear workable to those 
who must execute it, and will make use of an organiza- 
tion's resources to" overcome the obstacles to adoption and 
implementation. Strategics are composed of two kinds of 
elements: critical benchmarks and tasks. 



Randomization 



ERIC 



A procedure employed to ensure that treatment and control 
groups are equivalent except insofar «as differences arise 
by chance. Randomization serves to rule out rival 
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Glossary 



Regression 

Task(s) 
Theory 



True experiment 



t-test 



Victimization 



hypotheses about the sources of differences observed 
between treatment and control groups, and so leads to more 
rigorous evaluations. Because the technical meaning of 
randomization is not widely understood, randomization is 
t>est accomplished by experienced research personnel. 

(a) A statistical technique useful in the analysis of 
experimental ilnd quasi-experimental data, (b) Getting 
worse, (c) Movement from' an extreme position in a distri- 
bution to a more central position. 

The part of a strategy that specifies who will do what by 
when . 

A statement of why a problem exists or of how an organiza- 
tion may achieve a goal. A project's theory of action 
serves as a template for choosing and assessing interven- 
tions. 

An experiment involving the random assignment of units 
(people, schools, classrooms, etc.) to two or more treat- 
ments (one of which is often a non-intervention treatment, 

or control condition), 
i 

A test for the significance of differences in means (see 
means, significance) . 

Suffering personal harm, threat, or loss as a result of a 
crime • 
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